Debugger doesn't stop at breakpoints when running tests (but does during normal execution)

This is also related, I believe. It appears that the authors of the Julia VSCode plugin are already aware of the limitations in debugging while in @testsets, and focus is on the new testitem framework.