How do you speed up the linear sparse solver in Zygote?

For reference, Zygote.jl: How to get the gradient of sparse matrix - #12 by mohamed82008