Module X with build ID Y is missing from the cache. This may mean X [Z] does not support precompilation but is imported by a module that does

General Usage
1

Hi, I keep getting errors of the type “Module X with build ID Y is missing from the cache. This may mean X [Z] does not support precompilation but is imported by a module that does”.

I’m on v1.10.4 as this is what my HPC also runs on. Versioninfo() gives:

julia> versioninfo()
Julia Version 1.10.4
Commit 48d4fd48430 (2024-06-04 10:41 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: macOS (arm64-apple-darwin22.4.0)
  CPU: 8 × Apple M2
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, apple-m1)
Threads: 4 default, 0 interactive, 2 GC (on 4 virtual cores)
Environment:
  JULIA_EDITOR = code
  JULIA_VSCODE_REPL = 1
  JULIA_NUM_THREADS = 4

My Project.toml looks like

[deps]
AbstractTrees = "1520ce14-60c1-5f80-bbc7-55ef81b5835c"
AllocCheck = "9b6a8646-10ed-4001-bbdc-1d2f46dfbb1a"
BenchmarkTools = "6e4b80f9-dd63-53aa-95a3-0cdb28fa8baf"
Distributions = "31c24e10-a181-5473-b8eb-7969acd0382f"
FastClosures = "9aa1b823-49e4-5ca5-8b0f-3971ec8bab6a"
ForwardDiff = "f6369f11-7733-5829-9624-2563aa707210"
GLMakie = "e9467ef8-e4e7-5192-8a1a-b1aee30e663a"
HCubature = "19dc6840-f33b-545b-b366-655c7e3ffd49"
Interpolations = "a98d9a8b-a2ab-59e6-89dd-64a1c18fca59"
JLD2 = "033835bb-8acc-5ee8-8aae-3f567f8a3819"
LinearAlgebra = "37e2e46d-f89d-539d-b4ee-838fcccc9c8e"
Optim = "429524aa-4258-5aef-a3af-852621145aeb"
Profile = "9abbd945-dff8-562f-b5e8-e1ebf5ef1b79"
Random = "9a3f8284-a2c9-5f02-9a11-845980a1fd5c"
Revise = "295af30f-e4ad-537b-8983-00126c2a3abe"
SpecialFunctions = "276daf66-3868-5448-9aa4-cd146d93841b"
StaticArrays = "90137ffa-7385-5640-81b9-e52037218182"
Statistics = "10745b16-79ce-11e8-11f9-7d13ad32a3b2"
Symbolics = "0c5d862f-8b57-4792-8d23-62f2024744c7"

and the errors that I get are like

[ Info: Precompiling JLD2 [033835bb-8acc-5ee8-8aae-3f567f8a3819]
[ Info: Precompiling Distributions [31c24e10-a181-5473-b8eb-7969acd0382f]
Precompiling DistributionsChainRulesCoreExt
  2 dependencies successfully precompiled in 8 seconds. 52 already precompiled.
[ Info: Precompiling DistributionsChainRulesCoreExt [6db1f127-056a-568b-bd49-ae61d42389fa]
┌ Warning: Module Distributions with build ID fafbfcfd-f6c4-e797-0000-0a4396ca99c2 is missing from the cache.
│ This may mean Distributions [31c24e10-a181-5473-b8eb-7969acd0382f] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing DistributionsChainRulesCoreExt [6db1f127-056a-568b-bd49-ae61d42389fa].
Precompiling HCubature
  1 dependency successfully precompiled in 1 seconds. 17 already precompiled.
[ Info: Precompiling HCubature [19dc6840-f33b-545b-b366-655c7e3ffd49]
┌ Warning: Module DataStructures with build ID fafbfcfd-0e80-3ac0-0000-0a43a951ce03 is missing from the cache.
│ This may mean DataStructures [864edb3b-99cc-5e75-8d2d-829cb0a9cfe8] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing HCubature [19dc6840-f33b-545b-b366-655c7e3ffd49].
Precompiling Symbolics
  15 dependencies successfully precompiled in 125 seconds. 281 already precompiled.
[ Info: Precompiling Symbolics [0c5d862f-8b57-4792-8d23-62f2024744c7]
┌ Warning: Module DataStructures with build ID fafbfcfd-0e80-3ac0-0000-0a43a951ce03 is missing from the cache.
│ This may mean DataStructures [864edb3b-99cc-5e75-8d2d-829cb0a9cfe8] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing Symbolics [0c5d862f-8b57-4792-8d23-62f2024744c7].
[ Info: Precompiling SymbolicUtils [d1185830-fcd6-423d-90d6-eec64667417b]
┌ Warning: Module DataStructures with build ID fafbfcfd-0e80-3ac0-0000-0a43a951ce03 is missing from the cache.
│ This may mean DataStructures [864edb3b-99cc-5e75-8d2d-829cb0a9cfe8] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing SymbolicUtils [d1185830-fcd6-423d-90d6-eec64667417b].
[ Info: Precompiling MultivariatePolynomials [102ac46a-7ee4-5c85-9060-abc95bfdeaa3]
┌ Warning: Module DataStructures with build ID fafbfcfd-0e80-3ac0-0000-0a43a951ce03 is missing from the cache.
│ This may mean DataStructures [864edb3b-99cc-5e75-8d2d-829cb0a9cfe8] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing MultivariatePolynomials [102ac46a-7ee4-5c85-9060-abc95bfdeaa3].
[ Info: Precompiling DistributionsTestExt [ffbe0ea5-a612-5ff7-aaf5-cac02eef3019]
┌ Warning: Module Distributions with build ID fafbfcfd-f6c4-e797-0000-0a4396ca99c2 is missing from the cache.
│ This may mean Distributions [31c24e10-a181-5473-b8eb-7969acd0382f] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing DistributionsTestExt [ffbe0ea5-a612-5ff7-aaf5-cac02eef3019].
[ Info: Precompiling MultivariatePolynomialsChainRulesCoreExt [5a54e872-e74b-52e9-9e95-844b9896883d]
┌ Warning: Module MultivariatePolynomials with build ID ffffffff-ffff-ffff-0000-0a661a9bcd56 is missing from the cache.
│ This may mean MultivariatePolynomials [102ac46a-7ee4-5c85-9060-abc95bfdeaa3] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing MultivariatePolynomialsChainRulesCoreExt [5a54e872-e74b-52e9-9e95-844b9896883d].
[ Info: Precompiling DynamicPolynomials [7c1d4256-1411-5781-91ec-d7bc3513ac07]
┌ Warning: Module MultivariatePolynomials with build ID ffffffff-ffff-ffff-0000-0a661a9bcd56 is missing from the cache.
│ This may mean MultivariatePolynomials [102ac46a-7ee4-5c85-9060-abc95bfdeaa3] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing DynamicPolynomials [7c1d4256-1411-5781-91ec-d7bc3513ac07].
[ Info: Precompiling SymbolicUtilsChainRulesCoreExt [8667dd42-e7be-5897-adf6-2cf8b20d0a16]
┌ Warning: Module SymbolicUtils with build ID ffffffff-ffff-ffff-0000-0a65f569dec0 is missing from the cache.
│ This may mean SymbolicUtils [d1185830-fcd6-423d-90d6-eec64667417b] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing SymbolicUtilsChainRulesCoreExt [8667dd42-e7be-5897-adf6-2cf8b20d0a16].
[ Info: Precompiling SymbolicUtilsDistributionsExt [16f4a27c-14ae-5fbb-a387-050112e3c3fd]
┌ Warning: Module SymbolicUtils with build ID ffffffff-ffff-ffff-0000-0a65f569dec0 is missing from the cache.
│ This may mean SymbolicUtils [d1185830-fcd6-423d-90d6-eec64667417b] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing SymbolicUtilsDistributionsExt [16f4a27c-14ae-5fbb-a387-050112e3c3fd].
[ Info: Precompiling SymbolicLimits [19f23fe9-fdab-4a78-91af-e7b7767979c3]
┌ Warning: Module SymbolicUtils with build ID ffffffff-ffff-ffff-0000-0a65f569dec0 is missing from the cache.
│ This may mean SymbolicUtils [d1185830-fcd6-423d-90d6-eec64667417b] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing SymbolicLimits [19f23fe9-fdab-4a78-91af-e7b7767979c3].
Precompiling DifferentiationInterfaceSymbolicsExt
  1 dependency successfully precompiled in 2 seconds. 305 already precompiled.
[ Info: Precompiling DifferentiationInterfaceSymbolicsExt [e6c02559-e2b6-5021-bc6e-a9f025c2d0c8]
┌ Warning: Module Symbolics with build ID ffffffff-ffff-ffff-0000-0a65512fe42a is missing from the cache.
│ This may mean Symbolics [0c5d862f-8b57-4792-8d23-62f2024744c7] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing DifferentiationInterfaceSymbolicsExt [e6c02559-e2b6-5021-bc6e-a9f025c2d0c8].
[ Info: Precompiling SymbolicsHypergeometricFunctionsExt [fbb3f54f-d504-567e-9966-b613f6720d70]
┌ Warning: Module Symbolics with build ID ffffffff-ffff-ffff-0000-0a65512fe42a is missing from the cache.
│ This may mean Symbolics [0c5d862f-8b57-4792-8d23-62f2024744c7] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing SymbolicsHypergeometricFunctionsExt [fbb3f54f-d504-567e-9966-b613f6720d70].
Precompiling SymbolicsForwardDiffExt
  1 dependency successfully precompiled in 3 seconds. 296 already precompiled.
[ Info: Precompiling SymbolicsForwardDiffExt [4a213a23-c09c-5cde-9712-b631ad2c72df]
┌ Warning: Module Symbolics with build ID ffffffff-ffff-ffff-0000-0a65512fe42a is missing from the cache.
│ This may mean Symbolics [0c5d862f-8b57-4792-8d23-62f2024744c7] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing SymbolicsForwardDiffExt [4a213a23-c09c-5cde-9712-b631ad2c72df].
[ Info: Precompiling SymbolicsDistributionsExt [95e6e244-837b-51ae-9573-f4315c3fedfd]
┌ Warning: Module Symbolics with build ID ffffffff-ffff-ffff-0000-0a65512fe42a is missing from the cache.
│ This may mean Symbolics [0c5d862f-8b57-4792-8d23-62f2024744c7] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing SymbolicsDistributionsExt [95e6e244-837b-51ae-9573-f4315c3fedfd].
Precompiling GLMakie
  1 dependency successfully precompiled in 41 seconds. 267 already precompiled.
[ Info: Precompiling GLMakie [e9467ef8-e4e7-5192-8a1a-b1aee30e663a]
┌ Warning: Module DataStructures with build ID fafbfcfd-0e80-3ac0-0000-0a43a951ce03 is missing from the cache.
│ This may mean DataStructures [864edb3b-99cc-5e75-8d2d-829cb0a9cfe8] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing GLMakie [e9467ef8-e4e7-5192-8a1a-b1aee30e663a].
[ Info: Precompiling Makie [ee78f7c6-11fb-53f2-987a-cfe4a2b5a57a]
┌ Warning: Module DataStructures with build ID fafbfcfd-0e80-3ac0-0000-0a43a951ce03 is missing from the cache.
│ This may mean DataStructures [864edb3b-99cc-5e75-8d2d-829cb0a9cfe8] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing Makie [ee78f7c6-11fb-53f2-987a-cfe4a2b5a57a].
[ Info: Precompiling MathTeXEngine [0a4f8689-d25c-4efe-a92b-7142dfc1aa53]
┌ Warning: Module DataStructures with build ID fafbfcfd-0e80-3ac0-0000-0a43a951ce03 is missing from the cache.
│ This may mean DataStructures [864edb3b-99cc-5e75-8d2d-829cb0a9cfe8] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing MathTeXEngine [0a4f8689-d25c-4efe-a92b-7142dfc1aa53].
[ Info: Precompiling StructArrays [09ab397b-f2b6-538f-b94a-2f83cf4a842a]
Precompiling StructArraysExt
  2 dependencies successfully precompiled in 2 seconds. 26 already precompiled.
[ Info: Precompiling StructArraysExt [7174a82b-1e85-55a8-8a3d-2691d660c3ac]
┌ Warning: Module StructArrays with build ID fafbfcfd-151e-f459-0000-0a7cb9773b16 is missing from the cache.
│ This may mean StructArrays [09ab397b-f2b6-538f-b94a-2f83cf4a842a] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing StructArraysExt [7174a82b-1e85-55a8-8a3d-2691d660c3ac].
[ Info: Precompiling StructArraysStaticArraysExt [d1e1e8be-46cf-5459-abb8-be6c7518b661]
┌ Warning: Module StructArrays with build ID fafbfcfd-151e-f459-0000-0a7cb9773b16 is missing from the cache.
│ This may mean StructArrays [09ab397b-f2b6-538f-b94a-2f83cf4a842a] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing StructArraysStaticArraysExt [d1e1e8be-46cf-5459-abb8-be6c7518b661].
Precompiling StructArraysSparseArraysExt
  1 dependency successfully precompiled in 1 seconds. 19 already precompiled.
[ Info: Precompiling StructArraysSparseArraysExt [d5b9410b-929f-5d61-aab8-0598522fd334]
┌ Warning: Module StructArrays with build ID fafbfcfd-151e-f459-0000-0a7cb9773b16 is missing from the cache.
│ This may mean StructArrays [09ab397b-f2b6-538f-b94a-2f83cf4a842a] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing StructArraysSparseArraysExt [d5b9410b-929f-5d61-aab8-0598522fd334].
Precompiling StructArraysAdaptExt
  1 dependency successfully precompiled in 0 seconds. 25 already precompiled.
[ Info: Precompiling StructArraysAdaptExt [f04e5bcb-ab32-5a64-8b64-c2cc4abec66e]
┌ Warning: Module StructArrays with build ID fafbfcfd-151e-f459-0000-0a7cb9773b16 is missing from the cache.
│ This may mean StructArrays [09ab397b-f2b6-538f-b94a-2f83cf4a842a] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing StructArraysAdaptExt [f04e5bcb-ab32-5a64-8b64-c2cc4abec66e].
[ Info: Precompiling StructArraysLinearAlgebraExt [084ded39-0575-5459-ba0f-7a4568fdaad8]
┌ Warning: Module StructArrays with build ID fafbfcfd-151e-f459-0000-0a7cb9773b16 is missing from the cache.
│ This may mean StructArrays [09ab397b-f2b6-538f-b94a-2f83cf4a842a] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing StructArraysLinearAlgebraExt [084ded39-0575-5459-ba0f-7a4568fdaad8].
[ Info: Precompiling KernelDensity [5ab0869b-81aa-558d-bb23-cbf5423bbe9b]
┌ Warning: Module StatsBase with build ID fafbfcfd-d434-7825-0000-0a439f1b4b3b is missing from the cache.
│ This may mean StatsBase [2913bbd2-ae8a-5f71-8c99-4fb6c76f3a91] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing KernelDensity [5ab0869b-81aa-558d-bb23-cbf5423bbe9b].
Precompiling DomainSetsMakieExt
  ✓ Makie
  2 dependencies successfully precompiled in 75 seconds. 251 already precompiled.
  1 dependency precompiled but a different version is currently loaded. Restart julia to access the new version
[ Info: Precompiling DomainSetsMakieExt [da481366-01c8-5b4d-b359-47a10c8532e7]
┌ Warning: Module Makie with build ID ffffffff-ffff-ffff-0000-0a7bb16cd3be is missing from the cache.
│ This may mean Makie [ee78f7c6-11fb-53f2-987a-cfe4a2b5a57a] does not support precompilation but is imported by a module that does.
└ @ Base loading.jl:1948
[ Info: Skipping precompilation since __precompile__(false). Importing DomainSetsMakieExt [da481366-01c8-5b4d-b359-47a10c8532e7].

I’ve tried to look for solutions including clearing the cache, but these have not helped. How can I fix this? I feel that it might have something to do with GLMakie / Symbolics, as I only started to have this problem once I added GLMakie, and recall having a similar problem when trying to use UnicodePlots in the past.

2

You have two options:

  • upgrade Julia to 1.11 or higher
  • wait until a fixed version of 1.10 is released
3

The first unfortunately isn’t an option for me as the HPC only has 1.10.4 installed, and I would like to keep the version that I work on on my laptop in sync with the version used on the HPC. (I also don’t have this problem on the HPC, probably because I do not use GLMakie there).

In principle I can run the same no-GLMakie version on my laptop and only use the GLMakie version (which then triggers all the precompilation) when I need to make a few plots, but it feels a bit suboptimal to do it in that way.

4

Two things in computer science are hard, naming things and what you’re seeing—cache invalidation. Although Julia’s package management system is far superior to R and Pythons’ you run into these mismatches, especially with Makie, which has heavy dependencies.

Long short, as @ufechner7 suggests, go to 1.11. Then create a new environment and do the sanity check.

using Pkg; Pkg.status()

and nuke the old caches


# adjust VERSION to your actual Julia minor (e.g. v1.10)
rm -rf ~/.julia/compiled/v1*/Distributions
rm -rf ~/.julia/compiled/v1*/DataStructures
rm -rf ~/.julia/compiled/v1*/Symbolics
rm -rf ~/.julia/compiled/v1*/GLMakie
rm -rf ~/.julia/compiled/v1*/Makie
rm -rf ~/.julia/compiled/v1*/StructArrays
rm -rf ~/.julia/compiled/v1*/StatsBase

Restart Julia and

using Pkg
Pkg.precompile()
Pkg.resolve()       # fix any inconsistent constraints
Pkg.instantiate()   # ensure all deps are present
Pkg.precompile()

Because of Revise check Base.DEPOT_PATH in your session – make sure you aren’t pulling packages from an unexpected depot where a different version is installed.

If you use Distributed/addprocs, ensure you start workers after loading the environment and packages, and consider:

using DataStructures, Distributions, Symbolics, GLMakie
using Distributed
@everywhere using DataStructures, Distributions, Symbolics

If you have JULIA_DEPOT_PATH customized (e.g. via shell config or VS Code), try temporarily starting Julia with a single, empty depot:

JULIA_DEPOT_PATH=/tmp/julia_depot julia --project=.

and then Pkg.instantiate(); Pkg.precompile() inside that session; if the warnings disappear there, the issue is definitely stale caches in your usual depots.

The Makie related warnings are usually only for the extensions.

5

Julia is installed in the home folder; no special permissions are required. Can’t you do that yourself, even on a HPC cluster?

6

Julia doesn’t require admin/sudo permission, it is totally safe for you to use a custom juliaup version and the performance will be equal.
See Getting started

1 Like