I recently came across this project called XSEDE (Extreme Science and Engineering Discovery Environment) and was wondering if anyone has experience using Julia on this platform. Is it good for both data-intensive and computation-intensive tasks?
https://www.xsede.org/
https://www.nber.org/si2018_video/bigdatafinancialecon/AnirbanJana.pdf
1 Like
I used Comet, Bridges, and others on XSEDE with Julia (and GPUs) and it all worked well. If you look at my old parallelism tutorials they mention Comet a lot.
1 Like
Could you post the link of the tutorials?
It’s just on my blog. It’s probably Julia v0.5 code though, so the code would need an update, but the batch scripts and the style would still work.
Today I am going to show you how to parallelize your Julia code over some standard HPC interfaces. First I will go through the steps of parallelizing a simple code, and then running it with single-node parallelism and multi-node parallelism. The...
Est. reading time: 1 minute
This is a continuous of my previous post on using Julia on the XSEDE Comet HPC. Check that out first for an explanation of the problem. In that problem, we wished to solve for the area of a region where a polynomial was less than 1, which was...
Est. reading time: 3 minutes
This is the exciting Part 3 to using Julia on an HPC. First I got you started with using Julia on multiple nodes. Second, I showed you how to get the code running on the GPU. That gets you pretty far. However, if you got a trial allocation on...
Est. reading time: 21 minutes
(Disclaimer: This is not a full-Julia solution for using the Phi, and instead is a tutorial on how to link OpenMP/C code for the Xeon Phi to Julia. There may be a future update where some of these functions are specified in Julia, and Intel’s...
Est. reading time: 9 minutes
1 Like