This problem seems like it might be related to garbage collection issues discussed in this post: GC going nuts
I’m going to see if upgrading to v1.9 and providing a heap size hint that is substantially more than what Julia appears to be using helps with the excess garbage collection time.