# Turing: help with slow model
**URL:** https://discourse.julialang.org/t/turing-help-with-slow-model/54563
**Category:** Probabilistic Programming
**Created:** [February 3, 2021, 9:18pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563 "2021-02-03T21:18:53Z")
**Posts on this page:** 20
**Page:** 2
### Author:  [@trappmartin](https://discourse.julialang.org/u/trappmartin)
#### Post date: [February 4, 2021, 6:26pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/21 "2021-02-04T18:26:36Z")
In my opinion, vectorisation can sometime even simplify the model formulation and make it easier to read.
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 4, 2021, 6:29pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/22 "2021-02-04T18:29:38Z")
> [@Christopher\_Fisher](#):
>
> This should easy to do in Turing. Just pass `MCMCThreads()` and the number of chains as follows:
>
> `sample(model(sᵇ, nᵇ, sⁿ, nⁿ), NUTS(500,.65), MCMCThreads(), 1000, n_chains)`
>
> Aside from that, there is no special setup required.
So running that in VS Code (which I really like) gives an error
```julia
ERROR: LoadError: MethodError: no method matching sample(::DynamicPPL.Model{var"#8#9",(:sᵇ, :nᵇ, :sⁿ, :nⁿ, :T),(:T,),(),Tuple{Array{Int64,1},Int64,Array{Int64,1},Int64,Type{Float64}},Tuple{Type{Float64}}}, ::NUTS{Turing.Core.ReverseDiffAD{false},(),AdvancedHMC.DiagEuclideanMetric}, ::MCMCThreads, ::Int64, ::typeof(chains))
```
I tried doing it in the REPL and it doesn’t error, but it gives a warning that it’s not actually sampling in parallel.
```julia
Warning: Only a single thread available: MCMC chains are not sampled in parallel
```
which is consistent with what my activity monitor says.
Following the train of instructions makes it look like you have to start your Julia session specifying the number of threads. Although doing that with `julia --threads 4`
gives the error
```julia
zsh: command not found: julia
```
I’m not much of a command line ninja, but I think this means I need to set up julia environment variables.
Am I missing something here? Seems like it should be a bit easier than this?
---
### Author:  [@trappmartin](https://discourse.julialang.org/u/trappmartin)
#### Post date: [February 4, 2021, 6:53pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/23 "2021-02-04T18:53:17Z")
This looks like you haven’t set an alias for julia. And your command line cannot find the command. Do you know where the Julia binary is located?
---
### Author:  [@Christopher\_Fisher](https://discourse.julialang.org/u/Christopher_Fisher)
#### Post date: [February 4, 2021, 7:40pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/24 "2021-02-04T19:40:13Z")
> [@drbenvincent](#):
>
> Am I missing something here? Seems like it should be a bit easier than this?
Evidently, years ago I setup environment variables and forgot about it. Once you set it up, you do not have to reset it. On Mac and Linux, there is a hidden file called `.bashrc` in your home directory. Add the following line to it:
```julia
export JULIA_NUM_THREADS=8
```
Close VS Code and reopen it. Type the following to verify the number of threads:
`Threads.nthreads()`
Once you set that variable, it should always default to the specified number of threads.
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 4, 2021, 7:57pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/25 "2021-02-04T19:57:32Z")
I managed to get the alias working on MacOS by following the instructions here [Platform Specific Instructions for Official Binaries](https://julialang.org/downloads/platform/).
Manually starting with `julia --threads 8` then running the code works!
Now I feel better about spending that money on my 8 core iMac 🙂
But then to get that working all the time, I edited my `.basrc` file to add the line `export JULIA_NUM_THREADS=8`. Then I quit the terminal and VS Code.
Running `Threads.nthreads()` in the REPL and in terminal in VS Code gives the answer 1 ☹ Maybe I need a computer restart?
EDIT: No, that doesn’t seem to work.
---
### Author:  [@CameronBieganek](https://discourse.julialang.org/u/CameronBieganek)
#### Post date: [February 4, 2021, 8:09pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/26 "2021-02-04T20:09:09Z")
There’s a setting for the VS Code Julia extension. Type `Cmd + ,` to enter the settings viewer, then look for
```julia
Extension > Julia > Num Threads
```
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 4, 2021, 8:14pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/27 "2021-02-04T20:14:40Z")
Thanks @CameronBieganek, that works just great for VS Code.
It doesn’t recognise the `export JULIA_NUM_THREADS=8` in the `.basrc` file when manually running julia from the terminal. But I don’t do that very often, so it’s not a problem.
Thanks for all the suggestions!
---
### Author:  [@CameronBieganek](https://discourse.julialang.org/u/CameronBieganek)
#### Post date: [February 4, 2021, 8:17pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/28 "2021-02-04T20:17:32Z")
> [@drbenvincent](#):
>
> It doesn’t recognise the `export JULIA_NUM_THREADS=8` in the `.basrc` file when manually running julia from the terminal. But I don’t do that very often, so it’s not a problem.
Since you’re on Mac, I think you need to use a `.bash_profile` file instead of a `.bashrc` file.
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 4, 2021, 8:19pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/29 "2021-02-04T20:19:22Z")
Sorry that was a typo. I did actually edit `.bash_profile`. So bit of a head scratcher
---
### Author:  [@CameronBieganek](https://discourse.julialang.org/u/CameronBieganek)
#### Post date: [February 4, 2021, 8:20pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/30 "2021-02-04T20:20:17Z")
Did you restart the terminal after that? Do you mean launching Julia from Terminal.app, or launching Julia from the integrated bash terminal in VS Code?
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 4, 2021, 8:23pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/31 "2021-02-04T20:23:31Z")
Yes, quit the Terminal app. Opened Terminal app, typed `julia` (my alias now works!) but `Threads.nthreads()` results in 1.
In terms of VS Code, I get 8 threads if I run some Julia code from the editor which invokes a julia session in the terminal.
But if I manually open a julia session from the terminal inside VS Code, then the same things happens as above from a Terminal… 1 thread.
---
### Author:  [@CameronBieganek](https://discourse.julialang.org/u/CameronBieganek)
#### Post date: [February 4, 2021, 8:28pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/32 "2021-02-04T20:28:42Z")
> [@drbenvincent](#):
>
> Yes, quit the Terminal app. Opened Terminal app, typed `julia` (my alias now works!) but `Threads.nthreads()` results in 1.
Huh, that’s weird. I’m not sure why that would be.
> [@drbenvincent](#):
>
> In terms of VS Code, I get 8 threads if I run some Julia code from the editor which invokes a julia session in the terminal.
>
> But if I manually open a julia session from the terminal inside VS Code, then the same things happens as above from a Terminal… 1 thread.
Yeah, when I want to run Julia code in VS Code I either run the code from the editor with one of the keyboard shortcuts, or, more often, I first launch a Julia session by hitting `Cmd + Shift + P` and then running the `Julia: Start REPL` command (which does have a keyboard shortcut, but it’s more complicated).
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 4, 2021, 8:30pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/33 "2021-02-04T20:30:21Z")
But it’s basically working in VS Code now using my regular workflow, so that’s great. Thanks for the tips 👍
---
### Author:  [@trappmartin](https://discourse.julialang.org/u/trappmartin)
#### Post date: [February 4, 2021, 8:52pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/34 "2021-02-04T20:52:56Z")
From what I can tell you are not using bash but zsh. So you will need to edit the zsh profile file, not the one for bash. 😉
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 5, 2021, 10:55am UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/35 "2021-02-05T10:55:40Z")
In my defence I grew up on Matlab and I’m not a computer scientists 😛
FYI for anyone else…
In a terminal window, type `open ~/.zshrc` to open up your `.zshrc` file and then add the following line
```
export JULIA_NUM_THREADS=8
```
Save, close. Quit and restart terminal, and you’re set.
---
### Author:  [@drbenvincent](https://discourse.julialang.org/u/drbenvincent)
#### Post date: [February 5, 2021, 6:38pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/36 "2021-02-05T18:38:29Z")
> [@Christopher\_Fisher](#):
>
> Would you mind clarifying which parts of the code should be vectorized? In your version of the model, you used vectorization when initializing the parameters, but used the loop to compute the likelihood and fill in some of the parameter values. In my version, I vectorized all of the code, but it runs twice as slow. Is that a general finding?
Doing some final tests on this I’m finding the fully vectorized code to take ~60 seconds, but the partially vectorized code to take ~120 seconds. Weird.
---
### Author:  [@Christopher\_Fisher](https://discourse.julialang.org/u/Christopher_Fisher)
#### Post date: [February 5, 2021, 9:17pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/37 "2021-02-05T21:17:13Z")
I must have mixed up the code somehow. 🙄 I can reproduce your findings on my computer. The fully vectorized model is about twice as fast. It would be nice if both versions performed similarly. Sometimes vectorized code is easier to read and write. In other cases, it makes the code awkward.
On the surface it looks like the model with the loop has fewer memory allocations, but this is not true in practice. It has about 3x more allocations. It must be related to the way that ReverseDiff computes the gradients under the hood.
---
### Author:  [@michielver](https://discourse.julialang.org/u/michielver)
#### Post date: [February 7, 2021, 2:25pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/38 "2021-02-07T14:25:58Z")
I also started using the MCMCThreads approach, and it seems to work. However, what I notice is that for a long time I will have no ETA and thus no idea how far along the sampling is, is this ‘expected’ behavior? Like suddenly it will jump to 50% I once noticed.
---
### Author:  [@Christopher\_Fisher](https://discourse.julialang.org/u/Christopher_Fisher)
#### Post date: [February 7, 2021, 8:02pm UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/39 "2021-02-07T20:02:15Z")
This could happen on the first execution when you start a new session. Unfortunately, [compilation latency](https://github.com/TuringLang/Turing.jl/issues/1504) is long on the first execution. Do you still experience this issue on the second execution?
---
### Author:  [@michielver](https://discourse.julialang.org/u/michielver)
#### Post date: [February 8, 2021, 11:06am UTC](https://discourse.julialang.org/t/turing-help-with-slow-model/54563/40 "2021-02-08T11:06:14Z")
It seems quite consistent, unrelated to the first execution weirdly enough.
Edit:
It really seems to only show progress whenever 1 entire thread is done, because now I saw it jump to 25% for example (and I have 4 threads that it is being sampled from currently).
[Previous page](https://discourse.julialang.org/t/turing-help-with-slow-model/54563.md?page=1)
[Next page](https://discourse.julialang.org/t/turing-help-with-slow-model/54563.md?page=3)