I recently took a course focusing on parallelism in Julia and we had a discussion about this and we saw a similar pattern in one exercise.
As far as I understood, you might gain from reducing the BLAS threads when you use your own parallel program because you are competing for the same resources.