Thanks @simonbyrne. I am back to the issue of getting CUDA-aware MPI to work with cray-mpich. Thanks again for the OpenMPI solution at last minute before the AGU conference!
The only thing I can think of is to check that Julia and MPICH are using the same CUDA version?
How would you suggest to check that?