Hi, I had the same problem, here is my MWE:
using Flux
c = Conv((1,1),1=>1) |> gpu
x = rand(4,4,1,1) |> gpu
c(x)
This code led to the same error as @GlenHenshaw (I am on CUDA@3.6.1).
I modified /lib/cudnn/convolution.jl
as suggested by @maleadt and now the above code works.