"connection refused (ECONNREFUSED)" when trying to mpirun julia on multiple nodes

It’s possible that your cluster doesn’t allow TCP transport. You may have to use MPI for transport. Have you tried using MPI_TRANSPORT_ALL in start_main_loop?