Writing Data to JSON Files on HPC Cluster

Not sure if helpful, but I’ve had good luck using the BSON (binary JSON) package to write .bson files (from a Fortran PDE solver wrapped in Julia) on a SLURM cluster which I then analyze on my local linux box.

In my case, all the parallelization is in the Fortran code, and Julia is just the driver/wrapper, so its a bit different then your case. I have not used Distributed, but have done parallel programming, and this quick google search seems to contain your answer

https://stackoverflow.com/questions/60373801/how-do-i-do-i-o-in-julia-distributed-for-loop-run-non-interactively

BSON.jl

1 Like