Figured I’d check back in here with some time passed. I know some people have been working on various packages and Julia itself in response to some of this and related issues. I’m very happy to say as of latest package versions today and 1.8.2, my latency benchmarks now look like what you’d expect. Package load time increases by a little bit in 1.8 compared to 1.7, but TTFX decreased (rather than doubling like before). With this now working, excited to be able to try some of the 1.8 precompilation stuff.
Many thanks to the people involved! (can’t say I know the specific thing that did it, or if there even was just one)
