I haven’t tried doing it with the julia installed kernel. Did you try out jupyter notebooks with that conda installation without vscode? For example, does GitHub - JuliaLang/IJulia.jl: Julia kernel for Jupyter would fine?
If you do the notebook() call once, I bleieve that IJulia should install most or all of the dependencies?