Large performance regression in nightly build

General Usage Performance
1

Update the 1.8dev version today and …

  | | |_| | | | (_| |  |  Version 1.8.0-DEV.1519 (2022-02-13)
 _/ |\__'_|_|_|\__'_|  |  Commit 1978580e72 (1 day old master)
|__/                   |

julia> cd("C:/v"); @time using GMT
[ Info: Precompiling GMT [5752ebe1-31b9-557e-87aa-f909b540aa54]
 28.079569 seconds (2.25 M allocations: 138.780 MiB, 0.20% gc time, 7.73% compilation time)

julia> tic(); plot(rand(5,2)); toc()
elapsed time: 23.5743263 seconds
23.5743263

vs 1.7

  | | |_| | | | (_| |  |  Version 1.7.0 (2021-11-30)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

julia> cd("C:/v"); @time using GMT
[ Info: Precompiling GMT [5752ebe1-31b9-557e-87aa-f909b540aa54]
 20.927768 seconds (1.92 M allocations: 120.275 MiB, 0.23% gc time, 3.40% compilation time)

julia> tic(); plot(rand(5,2)); toc()
elapsed time: 6.4301933 seconds
6.4301933

the 1.8dev from ~1 month ago used to run TTFP in 5.5 sec.

2

Is this the same version of GMT?

3

Yes, It’s the one I build (and distribute on Windows)

4

No idea why it was so slow yesterday (and I tried several times). Trying again today sows more reasonable numbers, but the runtime is still slower (~0.75 sec) than the ~1 month ago version.

  | | |_| | | | (_| |  |  Version 1.8.0-DEV.1519 (2022-02-13)
 _/ |\__'_|_|_|\__'_|  |  Commit 1978580e72 (2 days old master)
|__/                   |

julia> cd("C:/v"); @time using GMT
[ Info: Precompiling GMT [5752ebe1-31b9-557e-87aa-f909b540aa54]
 23.074192 seconds (2.25 M allocations: 138.718 MiB, 0.10% gc time, 2.79% compilation time)

julia> tic(); plot(rand(5,2)); toc()
elapsed time: 6.2270409 seconds
6.2270409
5

Few weeks ago I did some git bisect between 1.7 and nightly. There were multiple speed-ups and slow-downs of TTFX. Compilation/inference/etc performance definitely has many significant ups and downs over the weeks. I have been thinking of setting up a daily tracker with the TTFX for various libraries on nightly.

7 Likes
6

oh, good, i was experimenting the same thing with nightly CI

7

And seems to be happening again

  | | |_| | | | (_| |  |  Version 1.9.0-DEV.84 (2022-02-24)
 _/ |\__'_|_|_|\__'_|  |  Commit 6b29ebda35 (1 day old master)
|__/                   |

julia> cd("C:/v"); @time using GMT
  1.394454 seconds (1.03 M allocations: 76.999 MiB, 1.85% gc time, 44.77% compilation time)

julia> tic(); plot(rand(5,2)); toc()
elapsed time: 9.3089013 seconds
9.3089013