I’ve been testing out the new Docker image for Julia 1.9-beta2. I do indeed notice the FFTX improvements, however I’m also noticing that precompilation of every package now takes on average between 1.5x-2x as long. versioninfo() yields: Julia Version 1.9.0-beta2 Commit 7daffeecb8c (2022-12-29 07:45…

[image] M-PERSIC: is this expected for the beta? Yes: https://github.com/JuliaLang/julia/pull/47184#issuecomment-1283162301

Can anybody explain the reason? Are there any plans to reduce this time in the future?

For OrdinaryDiffEq, this precompilation time ratio is even worse: > 3.2, making it difficult to accept. In a temporary env with an initial empty ~/.julia/compiled : # on 1.8.4 julia> @time using OrdinaryDiffEq # full deps stack precompilation + loading time 462.330531 seconds (19.18 M allocations…

In an environment with only OrdinaryDiffEq and clean compiled/ directory each time, v1.8.3: (tmp) pkg> precompile Precompiling project... 126 dependencies successfully precompiled in 125 seconds master (commit de73c26fbf ): (tmp) pkg> precompile Precompiling environment... 112 dependencies suc…

@giordano How many cpu cores do you have? I am afraid this doesn’t help much if you have only two of them…

I have 8. As far as I understand, PR #47797 uses half of the total cores for parallel image generation, so on a two-core machines that probably doesn’t help at all.

Going from Julia 1.8 to Julia 1.9.0-beta3, precompiling Pluto.jl (during Pkg.precompile()) went from 15 seconds to 60 seconds, pretty significant :worried:. We ran these tests many times, on different systems. After precompilation, TTFX did improve a little, it went from 30 seconds to 20 seconds. (…

Yes, UX can do a lot to to alleviate waiting. (Though this has improved a lot over versions of Pkg). Related, I suspect it might make Julia friendlier if it could tell when it was compiling sth during REPL usage (instead of silently hanging for a while) Power users, used to JIT, can then turn off…

[image] tfiers: I suspect it might make Julia friendlier if it could tell when it was compiling sth during REPL usage (instead of silently hanging for a while) `using` should trigger Pkg's parallel precompilation opened 08:25PM - 12 …

That’s a great suggestion. I was thinking here of JIT compilation instead of precompilation (admittedly a bit off-topic here) e.g: julia> plot([1, 3, 2]); Compiling … (which, after a few seconds, becomes: julia> plot([1, 3, 2]); Compiling … ✔ Repeating the call prints no such thing, as there’…

Julia 1.9.0-beta2 precompilation taking almost twice as long

General Usage

giordano January 4, 2023, 12:38pm 4

To put it simple, to make this possible: Julia v1.9.0-beta2 is fast. Julia now compiles and stores more code during precompilation (a one-off) to save time at runtime for each single session.

7 Likes

Topic		Replies	Views
First Pluto notebook launches are slower on Julia 1.9 beta 3 Internals & Design performance , pluto , ttfx	157	9790	February 10, 2023
10-15 minute TTFP with Plots.jl... Please help New to Julia ttfp	55	3159	January 9, 2023
Any way to speed up loading large precompiled packages? General Usage precompilation , ttfp , ttfx	35	3554	May 15, 2023
Everything precompiling when opening new notebook Performance question	8	1041	July 21, 2022
Precompilation takes ages General Usage	14	1805	January 5, 2024

Julia 1.9.0-beta2 precompilation taking almost twice as long

Related topics