Julia vscode language server startup time

My Julia language server takes very long to start up after opening vscode - over a minute every time.
Is there anything I can do to improve this?
I saw after a bit of searching that others do not seem to have this issue.

I am using the julia extension on vscode, and the VERSION constant is v"1.10.3".

Language server output on pastebin