Julia 1.11 is slower than 1.10?

Internals & Design
17

I feel like julia startup time is just not very stable:

akako@frame16 ~> hyperfine --warmup 1 'julia +1.10.5 --startup-file=no -e "1+1"'
Benchmark 1: julia +1.10.5 --startup-file=no -e "1+1"
  Time (mean ± σ):     141.9 ms ±  21.5 ms    [User: 77.6 ms, System: 98.4 ms]
  Range (min … max):   110.9 ms … 165.7 ms    19 runs

akako@frame16 ~> hyperfine --warmup 1 'julia +1.11.0 --startup-file=no -e "1+1"'
Benchmark 1: julia +1.11.0 --startup-file=no -e "1+1"
  Time (mean ± σ):     191.6 ms ±  91.6 ms    [User: 386.5 ms, System: 82.8 ms]
  Range (min … max):    86.4 ms … 432.4 ms    15 runs

akako@frame16 ~> hyperfine --warmup 1 'julia +1.11.0 --startup-file=no -e "1+1"'
Benchmark 1: julia +1.11.0 --startup-file=no -e "1+1"
  Time (mean ± σ):     152.9 ms ±  58.9 ms    [User: 329.9 ms, System: 58.1 ms]
  Range (min … max):    87.8 ms … 249.5 ms    24 runs

  Warning: Statistical outliers were detected. Consider re-running this benchmark on a quiet system without any interferences from other programs. It might help to use the '--warmup' or '--prepare' options.

julia> versioninfo()
Julia Version 1.11.0
Commit 501a4f25c2b (2024-10-07 11:40 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
  CPU: 16 × AMD Ryzen 7 7840HS w/ Radeon 780M Graphics
  WORD_SIZE: 64
  LLVM: libLLVM-16.0.6 (ORCJIT, znver4)
Threads: 16 default, 0 interactive, 8 GC (on 16 virtual cores)
Environment:
  JULIA_NUM_THREADS = auto

maybe try --warmup

2 Likes