As an update, there was an issue in the linker that was causing this. Set storage class of julia globals to dllimport on windows to avoid auto-import weirdness by gbaraldi · Pull Request #54572 · JuliaLang/julia · GitHub fixes the issue, and there will be a hotfix in Julia which which should follow as a Julia v1.10.4 ASAP.
Note that this is a Windows-only bug.
The linker bug is triggered seemingly based on the size of the image being compiled. There were a few changes that might’ve put us into this regime, in particular the new ODE defaulting system Redesign default ODE solver to be type-grounded and lazy by oscardssmith · Pull Request #2184 · SciML/OrdinaryDiffEq.jl · GitHub. For these changes, we’ve disabled them on Windows in the latest releases Disable Default solver on windows by oscardssmith · Pull Request #2224 · SciML/OrdinaryDiffEq.jl · GitHub. There isn’t all that much we can do to workaround the bug beyond this, but this should hopefully make it trigger for less people less often.