Is there any known issue with the speed of ChainRules.jl or ChainRulesTestUtils.jl on MacOS, in particular on the Github CI runners?
For our package TensorKit.jl, we have a quite extensive suite of tests that are ran via Github actions on Mac, Linux and Windows on different Julia versions. There is some variations in the test speeds, and we even run some different tests on different platforms to lower to total run time. However, the tests for the AD rules via ChainRules.jl and tested via ChainRulesTestUtils.jl (no Zygote.jl or other AD engine is being used) are exactly the same on each platform, but take hugely more time on Mac.
I was wondering if anyone has seen similar effects?
This is a selection from the CI output on MacOS:
Finished fusion tree tests in 326.0 seconds.
Fields and vector spaces | 5290 5290 1m28.7s
Tensors with symmetry: Trivial | 3037 3037 2m53.6s
Tensors with symmetry: Irrep[ℤ₂] | 4657 4657 5m50.6s
Tensors with symmetry: FermionParity | 3087 3087 1m33.0s
Tensors with symmetry: FermionSpin | 3115 3115 4m26.1s
Automatic Differentiation with spacetype ComplexSpace | 2025 2025 15m57.9s
Automatic Differentiation with spacetype Rep[ℤ₂] | 2424 2424 26m16.1s
Automatic Differentiation with spacetype Vect[FermionParity] | 2384 2384 27m56.2s
Automatic Differentiation with spacetype Rep[U₁] | 3421 3421 159m20.7s
Automatic Differentiation with spacetype Rep[SU₂] | 3000 3000 51m00.4s
Versus the same selection from Ubuntu (Windows is more or less similar):
Finished fusion tree tests in 385.0 seconds.
Fields and vector spaces | 5290 5290 1m24.3s
Tensors with symmetry: Trivial | 3037 3037 3m01.2s
Tensors with symmetry: Irrep[ℤ₂] | 4657 4657 4m54.0s
Tensors with symmetry: FermionParity | 3087 3087 1m45.7s
Tensors with symmetry: FermionSpin | 3115 3115 2m17.5s
Automatic Differentiation with spacetype ComplexSpace | 2025 2025 7m18.1s
Automatic Differentiation with spacetype Rep[ℤ₂] | 2426 2426 4m33.2s
Automatic Differentiation with spacetype Vect[FermionParity] | 2384 2384 5m19.5s
Automatic Differentiation with spacetype Rep[U₁] | 3421 3421 11m07.6s
Automatic Differentiation with spacetype Rep[SU₂] | 3000 3000 5m12.2s