Zygote + CUDA: scalar getindex with custom activation function using multiplication

Specific Domains GPU
4

Solved it. The issue was caused because the activation function returned a Float64 instead of a Float32. The scalar getindex issue was masking a no method matching error.