Unable to install CUDA - problem with CUDA_runtime package on HPC system

Hi,
I’m trying to install CUDA into a virtual environment on a HPC machine running Red Hat 8. I load the CUDA and Julia modules, and then I create a new virtual environment by creating a directory, cd’ing into it, starting julia, going into pkg then activate TestEnv. Then I try to install CUDA.

(TestEnv) pkg> add CUDA Resolving package versions... Installed Compat ───────────── v4.14.0 Installed KernelAbstractions ─ v0.9.17 Updating /bask/projects/e/Julia/TestEnv/TestEnv/Project.toml [052768ef] + CUDA v5.2.0 Updating/bask/projects/e/Julia/TestEnv/TestEnv/Manifest.toml [621f4979] + AbstractFFTs v1.5.0 ⌃ [ab4f0b2a] + BFloat16s v0.4.2 [fa961155] + CEnum v0.5.0 [052768ef] + CUDA v5.2.0 [1af6417a] + CUDA_Runtime_Discovery v0.2.3 [3da002f7] + ColorTypes v0.11.4 [5ae59095] + Colors v0.12.10 [34da2185] + Compat v4.14.0 [a8cc5b0e] + Crayons v4.1.1 [9a962f9c] + DataAPI v1.16.0 [a93c6f00] + DataFrames v1.6.1 [864edb3b] + DataStructures v0.18.17 [e2d170a0] + DataValueInterfaces v1.0.0 [e2ba6199] + ExprTools v0.1.10 [53c48c17] + FixedPointNumbers v0.8.4 [0c68f7d7] + GPUArrays v10.0.2 [46192b85] + GPUArraysCore v0.1.6 ⌅ [61eb1bfa] + GPUCompiler v0.25.0 [842dd82b] + InlineStrings v1.4.0 [41ab1584] + InvertedIndices v1.3.0 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.5.0 [63c18a36] + KernelAbstractions v0.9.17 [929cbde3] + LLVM v6.6.0 [8b046642] + LLVMLoopInfo v1.0.0 [b964fa9f] + LaTeXStrings v1.3.1 [1914dd2f] + MacroTools v0.5.13 [e1d29d7a] + Missings v1.1.0 [5da4648a] + NVTX v0.3.4 [bac558e1] + OrderedCollections v1.6.3 [69de0a69] + Parsers v2.8.1 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.2.0 [21216c6a] + Preferences v1.4.1 [08abe8d2] + PrettyTables v2.3.1 [74087812] + Random123 v1.7.0 [e6cf234a] + RandomNumbers v1.5.3 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.0 [6c6a2e73] + Scratch v1.2.1 [91c51154] + SentinelArrays v1.4.1 [a2af1166] + SortingAlgorithms v1.2.1 [90137ffa] + StaticArrays v1.9.3 [1e83bf80] + StaticArraysCore v1.4.2 [892a3eda] + StringManipulation v0.3.4 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.11.1 [a759f4b9] + TimerOutputs v0.5.23 [013be700] + UnsafeAtomics v0.2.1 [d80eeb9a] + UnsafeAtomicsLLVM v0.1.3 [4ee394cb] + CUDA_Driver_jll v0.7.0+1 [dad2f222] + LLVMExtra_jll v0.0.29+0 [e98f9f5b] + NVTX_jll v3.1.0+2 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [9fa8497b] + Future [b77e0a4c] + InteractiveUtils [4af54fe1] + LazyArtifacts [b27032c2] + LibCURL v0.6.3 [76f85450] + LibGit2 [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [56ddb016] + Logging [d6f4376e] + Markdown [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.9.2 [de0858da] + Printf [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [2f01184e] + SparseArrays [10745b16] + Statistics v1.9.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll v1.0.5+0 [deac9b47] + LibCURL_jll v7.84.0+0 [29816b5a] + LibSSH2_jll v1.10.2+0 [c8ffd9c3] + MbedTLS_jll v2.28.2+0 [14a3606d] + MozillaCACerts_jll v2022.10.11 [4536629a] + OpenBLAS_jll v0.3.21+4 [bea87d4a] + SuiteSparse_jll v5.10.1+6 [83775a58] + Zlib_jll v1.2.13+0 [8e850b90] + libblastrampoline_jll v5.8.0+0 [8e850ede] + nghttp2_jll v1.48.0+0 [3f19e933] + p7zip_jll v17.4.0+0 Info Packages marked with → are not downloaded, useinstantiateto download Info Packages marked with ⌃ and ⌅ have new versions available, but those with ⌅ are restricted by compatibility constraints from upgrading. To see why usestatus --outdated -m`
Downloaded artifact: CUDA_Runtime
Downloaded artifact: CUDA_Runtime
ERROR: Unable to automatically download/install artifact ‘CUDA_Runtime’ from sources listed in ‘/bask/homes/a/allsoppj/.julia/packages/CUDA_Runtime_jll/rcOoh/Artifacts.toml’.
Sources attempted:

Stacktrace:
[1] error(s::String)
@ Base ./error.jl:35
[2] ensure_artifact_installed(name::String, meta::Dict{String, Any}, artifacts_toml::String; platform::Base.BinaryPlatforms.Platform, verbose::Bool, quiet_download::Bool, io::Base.TTY)
@ Pkg.Artifacts /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/Artifacts.jl:443
[3] download_artifacts(env::Pkg.Types.EnvCache; platform::Base.BinaryPlatforms.Platform, julia_version::VersionNumber, verbose::Bool, io::Base.TTY)
@ Pkg.Operations /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/Operations.jl:756
[4] instantiate(ctx::Pkg.Types.Context; manifest::Nothing, update_registry::Bool, verbose::Bool, platform::Base.BinaryPlatforms.Platform, allow_build::Bool, allow_autoprecomp::Bool, kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
@ Pkg.API /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/API.jl:1753
[5] precompile(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; internal_call::Bool, strict::Bool, warn_loaded::Bool, already_instantiated::Bool, timing::Bool, kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
@ Pkg.API /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/API.jl:1118
[6] precompile
@ /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/API.jl:1115 [inlined]
[7] #_auto_precompile#7
@ /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/Pkg.jl:790 [inlined]
[8] _auto_precompile (repeats 2 times)
@ /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/Pkg.jl:788 [inlined]
[9] add(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.TTY, kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
@ Pkg.API /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/API.jl:157
[10] add(pkgs::Vector{Pkg.Types.PackageSpec})
@ Pkg.API /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/API.jl:145
[11] do_cmd!(command::Pkg.REPLMode.Command, repl::REPL.LineEditREPL)
@ Pkg.REPLMode /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/REPLMode/REPLMode.jl:412
[12] do_cmd(repl::REPL.LineEditREPL, input::String; do_rethrow::Bool)
@ Pkg.REPLMode /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/REPLMode/REPLMode.jl:390
[13] do_cmd
@ /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/REPLMode/REPLMode.jl:380 [inlined]
[14] (::Pkg.REPLMode.var"#24#27"{REPL.LineEditREPL, REPL.LineEdit.Prompt})(s::REPL.LineEdit.MIState, buf::IOBuffer, ok::Bool)
@ Pkg.REPLMode /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/Pkg/src/REPLMode/REPLMode.jl:557
[15] #invokelatest#2
@ ./essentials.jl:816 [inlined]
[16] invokelatest
@ ./essentials.jl:813 [inlined]
[17] run_interface(terminal::REPL.Terminals.TextTerminal, m::REPL.LineEdit.ModalInterface, s::REPL.LineEdit.MIState)
@ REPL.LineEdit /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/REPL/src/LineEdit.jl:2647
[18] run_frontend(repl::REPL.LineEditREPL, backend::REPL.REPLBackendRef)
@ REPL /bask/apps/live/EL8-ice/software/Julia/1.9.2-linux-x86_64/share/julia/stdlib/v1.9/REPL/src/REPL.jl:1300
[19] (::REPL.var"#62#68"{REPL.LineEditREPL, REPL.REPLBackendRef})()
@ REPL ./task.jl:514`

I’ve tried running instantiate after this, but to no avail, same error. I’m wondering if this is a virus protection thing based on other threads? I’ve tried this either sied of the weekend so unlikely to be a problem with the server.

Please format your post, it is hard to read. See Please read: make it easier to help you

The relevant part seems to be:

ERROR: Unable to automatically download/install artifact ‘CUDA_Runtime’ from sources listed in ‘/bask/homes/a/allsoppj/.julia/packages/CUDA_Runtime_jll/rcOoh/Artifacts.toml’.
Sources attempted:

    https://pkg.julialang.org/artifact/c0e6b8fff2621303ace1cc360b7fca676b4e28fd
    Error: AssertionError: size == padded_size == 0
    https://github.com/JuliaBinaryWrappers/CUDA_Runtime_jll.jl/releases/download/CUDA_Runtime-v0.11.1+0/CUDA_Runtime.v0.11.1.x86_64-linux-gnu-cuda+12.3.tar.gz
    Error: AssertionError: size == padded_size == 0

… which is a bad error (AssertionError when extracting tarball · Issue #80 · JuliaIO/Tar.jl · GitHub) indicating that the download failed. Please verify you have a working internet connection and that you can download those files from within the environmentl