Hi. I have a trained Flux model which I wish to apply repeatedly using separate calls from an external program.
Since Julia1.5 (and corresponding Flux version) every time the function
is called, the line
requires about 15 seconds to ‘initialize the CUDA driver’.
I do not even wish to use CUDA, and anyway, this deployment would only require milliseconds to compute with CPU.
Is there a way to import Flux without this (painfully slow) overhead each time I want to deploy the model?
PS The time taken for this is variable… sometimes it take up to a minute to just get past ‘using Flux’.