Any idea what can be going on here? [lmartine@coaraci ~]$ julia +1.10 --startup-file=no _ _ _ _(_)_ | Documentation: https://docs.julialang.org (_) | (_) (_) | _ _ _| |_ __ _ | Type "?" for help, "]?" for Pkg help. | | | | | | |/ _` | | | | |_| | …

Thanks Giordano. That seems to have reduced the number of errors, but I still get many others: $ echo $JULIA_NUM_PRECOMPILE_TASKS 1 $ julia --startup-file=no The latest version of Julia in the `release` channel is 1.11.3+0.x64.linux.gnu. You currently have `1.11.1+0.x64.linux.gnu` installed. Run: …

[image] lmiq: Thanks Giordano. That seems to have reduced the number of errors, but I still get many others: Did you export the variable? What’s ENV["JULIA_NUM_PRECOMPILE_TASKS"] inside Julia? [image] lmiq: so that’s probably part of the issue. Maybe not all of it? That’s the entire …

[image] giordano: Did you export the variable? What’s ENV["JULIA_NUM_PRECOMPILE_TASKS"] inside Julia? Yes: julia> ENV["JULIA_NUM_PRECOMPILE_TASKS"] "1" The issue is indeed that one, as the cluster admins asked me to try in another node where the restriction on the number of tasks was not se…

[image] lmiq: But the manual setting of the number of precompile tasks does not seem to be working completely in the head node. (the number of threads is is indeed one - as checked by “top”, but the error persists). Sounds like a problem in lld then, maybe it’s running itself with multiple th…

I’m sorry for the ignorance. That means exactly what in practice? Something I can do, or the cluster admins, or something else?

I don’t know, needs more exploration, I never used systems where lld was killed that badly so I never got a need/chance to do it myself.

Now I know that the limits where set on the cluster with: # Limits for DSUsers group @DSUsers hard nproc 100 @DSUsers soft nproc 32 @DSUsers hard memlock 512M @DSUsers soft memlock 256M Maybe the precompilation is hitting these memory limits?

I ran $ /usr/bin/time -v julia -e "import Pkg; Pkg.activate(temp=true); Pkg.add(\"Plots\")" which gave me: Precompiling project... 139 dependencies successfully precompiled in 101 seconds. 48 already precompiled. Command being timed: "julia -e import Pkg; Pkg.activate(temp=true); Pkg.add("Plot…

Precompilation error in cluster

General Usage

giordano January 22, 2025, 3:57pm 2

Set JULIA_NUM_PRECOMPILE_TASKS to a low value (this has been asked several times)

1 Like

Precompile llvm errors

Topic		Replies	Views
Ocassional precompile error on a cluster using julia1.8 General Usage question , precompilation	9	886	September 21, 2022
Precompile llvm errors General Usage question	1	131	August 6, 2025
Precompilation Fails on HPC General Usage error , precompilation	16	1122	October 9, 2023
Precompiling error for unknown reason New to Julia	10	669	December 3, 2023
Precompilation keeps repeating Performance	13	252	February 24, 2025

Precompilation error in cluster

Related topics