Is there any plan for GPU linear algebra?

Specific Domains GPU
1

I was trying to transfer from PyTorch, however, we don’t have a magma wrapper at the moment, do we? So is there anything includes things like SVD on GPU?

And is there any plan (or anyone interested in this) to make a wrapper for magma? (or whatever supports linear algebra on GPU).

2

Hi, did you notice this?GPU - JuliaLang

3

IIUC CUBLAS uses MAGMA internally for some operations, and CuArrays.jl uses CUBLAS so that’s a way to do linalg on NVIDIA GPUs. Not all of CUBLAS is wrapped, and not all of the linalg stdlib is supported, but wrapping additional calls is pretty easy (see eg. recent PRs like this one). Same thing with CUSOLVER for eg. svd.

3 Likes
4

Not much here yet, but from reading the runtests.jl it seems to be able to call a couple of the BLAS routines at least. Probably a good place to start!
https://github.com/JuliaGPU/MAGMA.jl/

1 Like