# Unable to use local CUDA runtime toolkit

**URL:** <https://discourse.julialang.org/t/unable-to-use-local-cuda-runtime-toolkit/113980>\
**Category:** GPU\
**Created:** [May 8, 2024, 4:56am UTC](https://discourse.julialang.org/t/unable-to-use-local-cuda-runtime-toolkit/113980 "2024-05-08T04:56:05Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![mtyogi](https://avatars.discourse-cdn.com/v4/letter/m/6f9a4e/32.png) [@mtyogi](https://discourse.julialang.org/u/mtyogi)\
**Post date:** [May 8, 2024, 4:56am UTC](https://discourse.julialang.org/t/unable-to-use-local-cuda-runtime-toolkit/113980/1 "2024-05-08T04:56:05Z")

</div>

Hi All,

I am trying use local CUDA runtime (12.4) toolkit, but I get the following error.

```julia

└ @ CUDA_Runtime_Discovery C:\Users\mohitt\.julia\packages\CUDA_Runtime_Discovery\ZGnCZ\src\CUDA_Runtime_Discovery.jl:139
┌ Debug: Could not discover CUDA toolkit
│ exception =
│ Could not find library 'nvToolsExt' in your local CUDA installation.
│ Stacktrace:
│ [1] error(s::String)
│ @ Base .\error.jl:35
│ [2] get_library(dirs::Vector{String}, name::String; optional::Bool)

```

I have all the required library installed in CUDA toolkit, and CUDA runtime is able to discover them, except for this one. Here [NVTX - NVIDIA Tools Extension Library](https://nvidia.github.io/NVTX/), it is mentioned that NVTX is no longer a compiled library (it is now header-only). This makes sense, as I could not find Nsight NVTX installation option in the NVIDIA CUDA 12.4 installer.

```julia
julia> versioninfo()
Julia Version 1.10.0
Commit 3120989f39 (2023-12-25 18:01 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: 16 × 11th Gen Intel(R) Core(TM) i7-11800H @ 2.30GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, tigerlake)
  Threads: 1 on 16 virtual cores
Environment:
  JULIA_DEBUG = CUDA_Runtime_Discovery
  JULIA_DIR = C:\Users\AppData\Local\Programs\julia-1.10.0\lib\julia
  JULIA_IMAGE_THREADS = 4
  JULIA_NUM_THREADS = 1

```

---

<div class="post-metadata">

**Author:** ![maleadt](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/maleadt/32/10097_2.png) [@maleadt](https://discourse.julialang.org/u/maleadt)\
**Post date:** [May 8, 2024, 6:46am UTC](https://discourse.julialang.org/t/unable-to-use-local-cuda-runtime-toolkit/113980/2 "2024-05-08T06:46:17Z")

</div>

You’re right, this can be removed from CUDA\_Runtime\_Discovery.jl. Can you file an issue there?

Also, what’s the reason you’re using a local toolkit? This is not recommended.

---

<div class="post-metadata">

**Author:** ![mtyogi](https://avatars.discourse-cdn.com/v4/letter/m/6f9a4e/32.png) [@mtyogi](https://discourse.julialang.org/u/mtyogi)\
**Post date:** [May 8, 2024, 7:59am UTC](https://discourse.julialang.org/t/unable-to-use-local-cuda-runtime-toolkit/113980/3 "2024-05-08T07:59:44Z")

</div>

Thank you for the reply, I have filled the [issue](https://github.com/JuliaGPU/CUDA.jl/issues/2367).

CUDA.jl (always) works well with the runtime artifact. I am exploring the possibility of not downloading the artifact and rather using the local installation, to reduce the size of the compiled app.