# Run a julia application at large scale (on thousands of nodes)

**URL:** https://discourse.julialang.org/t/run-a-julia-application-at-large-scale-on-thousands-of-nodes/23873
**Category:** Julia at Scale
**Tags:** question
**Created:** [May 5, 2019, 3:15pm UTC](https://discourse.julialang.org/t/run-a-julia-application-at-large-scale-on-thousands-of-nodes/23873 "2019-05-05T15:15:39Z")
**Posts on this page:** 1
**Showing post:** 5

<div class="post-metadata">

### Author: ![johnh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/johnh/32/3615_2.png) [@johnh](https://discourse.julialang.org/u/johnh)
#### Post date: [May 7, 2019, 3:18pm UTC](https://discourse.julialang.org/t/run-a-julia-application-at-large-scale-on-thousands-of-nodes/23873/5 "2019-05-07T15:18:24Z")

</div>

Hello @samo I looked for this thread for you

> [@Precompilation error using HPC](https://discourse.julialang.org/t/precompilation-error-using-hpc/17094/2):
>
> This particular error is fixed with [https://github.com/JuliaLang/julia/pull/29325](https://github.com/JuliaLang/julia/pull/29325) and will be in 1.0.2. Unfortunately, it just means that another more descriptive error message will be thrown.

The answer seems to be to create a local cache. You can do this even if you are running the compute nodes in a RAMdisk - you should still have a writeable /tmp

# make a local temp directory for the cache

TMPDIR=`mktemp -d`  
mkdir “$TMPDIR/compiled”

# copy the cache to the temp directory

rsync -au “$JULIA\_DEPOT\_PATH/compiled/v1.0” “$TMPDIR/compiled/”

# set the temp directory as the first depot so any (re)compilation will happen there and not interfere with other jobs

export JULIA\_DEPOT\_PATH=“$TMPDIR:$JULIA\_DEPOT\_PATH”

---

_[View the full topic](https://discourse.julialang.org/t/run-a-julia-application-at-large-scale-on-thousands-of-nodes/23873)._
