Multiple tasks on GPU resulting in CUSOLVERError for large number of tasks

[maleadt]

@Eveee

Is there a way to check whether I am running close to OOM? E.g. if I am writing a package for other users, can I somehow find out how much memory is available on their GPU, or specifically how many simultaneous tasks I can launch without running close to OOM?

You can check available memory with functions like CUDA.total_memory() and CUDA.available_memory(), just like in Base for checking CPU memory (where similarly you can’t just go and launch an unbounded number of tasks without running into OOM).