DifferentialEquations.jl+MPI.jl+PencilArrays.jl: Lack of scaling observed

[ChrisRackauckas]

@mmesiti

A study on the number of threads instead seems to hint that the part outside the derivative computation does not seem to take advantage of multiple threads.

There are threading choices for the solver parts. But before looking at that, can you share a flamegraph?