Could anyone recommend the best tool for analyzing Julia’s compilation process? I’m facing an issue where my code runs quickly, but the compilation time is excessively slow. I’ve looked into generic advice regarding TypeValues, but that doesn’t seem to be the root of the problem in my case. As I’m new to this type of issue, I’m seeking an automated tool that could assist in identifying the bottleneck. Any suggestions or guidance would be greatly appreciated.

It depends on the question you want to ask. to ask “which of my MethodInstances takes longest to infer?”, use@snoopi_deep to ask “which of my CodeInstances takes the longest for LLVM to optimize?”, then use julia --trace-compile or @snoopl to ask, “which part of inference or codegen is causing the bottleneck?”, start a fresh session and use @profile call_my_function(args...) for the first time. You’ll be mostly profiling the compiler, assuming your function runs quickly once compiled.

The thread is quite old. A lot has changed since then. Of course, invalidations are still relevant but SnoopCompile.jl got major updates in between. Just to be sure, the first step should be profiling with @profview or similar tools to see the lines of code most time is spend. Even if runtime is fast, it might give an indication. Once you go into details, then SnoopCompile.jl, JET.jl and Cthulhu.jl are useful. See also Optimizing your code .

Thanks! Profiling the first run was really helpful. My actual problem was with hcat(staticvectors...). In this scenario, for each different number of static vectors, hcat precompiles a different method. I replaced it with stack(staticvectors), and my problem was resolved with no loss of runtime performance.

Tools to Analyze Long Julia Compilation Times

New to Julia

mrufsvold January 31, 2024, 2:16pm 2

Check out this thread!

Topic		Replies	Views
Help diagnosing slow compilation General Usage compilation , profiling	4	307	August 12, 2024
How to troubleshoot when precompilation takes a long time? General Usage	1	508	July 31, 2019
Understanding and optimizing compiler time (just a bit) General Usage question	20	9104	March 25, 2021
Profiling compilation/inference Performance inference	10	1651	August 24, 2020
New tools for reducing compiler latency Package Announcements	7	4151	January 28, 2021

Tools to Analyze Long Julia Compilation Times

Related topics