How to setup Julia & Flux with CUDA & cuDNN on a computing cluster?

Check that there is not a proxy in the cluster. In that case, you should have to configurate github for allowing to download, see:

Has the cluster access to internet? If not, that could have a more difficult solution.