I have figured out what the problem was. Thank you for all the replies. I have a Virtual Machine running Linux Mint and had a kernel running there in Jupyterlab as well (even though the VM was powered off, which is weird). Once shutting down those Kernels, Jupyterlab behaves normally in Windows. This is a very specific issue, but other people might run into the same thing in the future.