Yes, CUDA.jl has a NVML submodule which exposes functionality like nvidia-smi. For memory usage, see memory_info. Not all NVML functions are wrapped, so have a look at the NVIDIA documentation too; all C functions are available under the NVML namespace as well.
2 Likes