Question About New GC Threads

TI36XPro
Thu, 28 Dec 2023 03:52:03 +0000
General Usage

I am excited to start using Julia 1.10.0 since I have a particular set of simulations which are allocation heavy (many small allocations) and I believe the GC is the current bottleneck.

I want to make sure I am doing this right. I think to start, it would make sense to split total threads available between those used for GC and those for computing. In that case I am running the following.

My run script contains the following lines (summarizing)

# runscript.slurm

#SBATCH --ntasks-per-node=12

GC_THREADS=6
COMPUTE_THREADS=6

main="my_simulation.jl"

export OMP_NUM_THREADS=$COMPUTE_THREADS

julia --project=@. --gcthreads=$GC_THREADS $main

The idea here is that I don’t want the GC threads to compete with the BLAS threads right? So it wouldn’t make sense to have both be set to 12 (total threads in this example).

Also - I can double check the number of BLAS threads by doing BLAS.get_num_threads(). Is there any similar function for checking number of GC threads?

8 posts - 3 participants