# Parallelize nested loop in v1.72

**URL:** <https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612>\
**Category:** General Usage\
**Tags:** performance, parallel\
**Created:** [August 11, 2022, 12:14pm UTC](https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612 "2022-08-11T12:14:30Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![bast](https://avatars.discourse-cdn.com/v4/letter/b/3e96dc/32.png) [@bast](https://discourse.julialang.org/u/bast)\
**Post date:** [August 11, 2022, 12:14pm UTC](https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612/1 "2022-08-11T12:14:30Z")

</div>

Hi,

I didn’t find any recent thread on this topic and from the documentation it seemed like development in this area was very active so I was wondering if there is some updated information.

I run a simulation model that takes a couple different parameters and I would like to loop over different values of two of them in parallel on my laptop (Macbook M1 if important), i.e. in a simplified form my code would look something like this,

```julia
convergence_time = zeros(10,10)
for a in 1:10
   for b in 1:10
       res = simulate_model(a,b)
       convergence_time[a,b] = res.t_conv
    end
end

```

Now I tried to parallelize this by using `Threads.@threads` on both for loops:

```julia
convergence_time = zeros(10,10)
Threads.@threads for a in 1:10
   Threads.@threads for b in 1:10
       res = simulate_model(a,b)
       convergence_time[a,b] = res.t_conv
    end
end

```

which did speed up the calculation but I am wondering if that is currently the best way to go about it.

Thank you very much!

---

<div class="post-metadata">

**Author:** ![cmarcotte](https://avatars.discourse-cdn.com/v4/letter/c/a3d4f5/32.png) [@cmarcotte](https://discourse.julialang.org/u/cmarcotte)\
**Post date:** [August 11, 2022, 12:39pm UTC](https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612/2 "2022-08-11T12:39:46Z")

</div>

The details will very much depend on what `simulate_model(a,b)` does. If you’re solving an ODE, perhaps consider an ensemble problem in `DifferentialEquations.jl` using `EnsembleThreads()` (though if the simulation is sufficiently short, then doing things serially might work out faster). Otherwise, you can of course simplify your nested loops with `for a in 1:10, b in 1:10`, which may permit the compiler to simplify things more readily, or at least save the overhead of the 10 thread spawns in the inner loop. Finally, for M1-based machines, using the Apple Silicon native Julia (\>1.8) would be faster and less buggy, while also giving you a dynamic thread scheduler by default, which may make better use of your compute resources than the static scheduler in 1.7.

---

<div class="post-metadata">

**Author:** ![lungben](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/lungben/32/12314_2.png) [@lungben](https://discourse.julialang.org/u/lungben)\
**Post date:** [August 11, 2022, 12:39pm UTC](https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612/3 "2022-08-11T12:39:49Z")

</div>

Nested parallel for loops should be in general fine to do from Julia v1.8 on, see [https://github.com/JuliaLang/julia/blob/v1.8.0-rc4/NEWS.md#multi-threading-changes](https://github.com/JuliaLang/julia/blob/v1.8.0-rc4/NEWS.md#multi-threading-changes)

For current Julia versions, this creates too much overhead. In any case, it should be sufficient to parallelize the outer for loop unless you have more than 10 cores.

---

<div class="post-metadata">

**Author:** ![bast](https://avatars.discourse-cdn.com/v4/letter/b/3e96dc/32.png) [@bast](https://discourse.julialang.org/u/bast)\
**Post date:** [August 11, 2022, 12:44pm UTC](https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612/4 "2022-08-11T12:44:49Z")

</div>

Okay, thank you very much!  
I was a bit hesitant to update to 1.8 since it is still experimental but I will give it a try!

---

<div class="post-metadata">

**Author:** ![DNF](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/dnf/32/10191_2.png) [@DNF](https://discourse.julialang.org/u/DNF)\
**Post date:** [August 11, 2022, 1:11pm UTC](https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612/5 "2022-08-11T13:11:27Z")

</div>

> [@lungben](#):
>
> Nested parallel for loops should be in general fine to do from Julia v1.8 on

But can you nest the `@threads` macro? I thought you had to use `@spawn` or something for that.

---

<div class="post-metadata">

**Author:** ![lungben](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/lungben/32/12314_2.png) [@lungben](https://discourse.julialang.org/u/lungben)\
**Post date:** [August 11, 2022, 1:19pm UTC](https://discourse.julialang.org/t/parallelize-nested-loop-in-v1-72/85612/6 "2022-08-11T13:19:28Z")

</div>

If I understand the news.md file correctly, yes:

> - `Threads.@threads` now defaults to a new `:dynamic` schedule option which is similar to the previous behavior except that iterations will be scheduled dynamically to available worker threads rather than pinned to each thread. This behavior is more composable with (possibly nested) `@spawn` and `@threads` loops ([#43919](https://github.com/JuliaLang/julia/issues/43919), [#44136](https://github.com/JuliaLang/julia/issues/44136)).

But I have not tested it yet.