in our Flux ML project, we need to process large volume of data with a single models. We do it by dividing the minibatch into chunks, calculate gradient on each chunk in a separate thread, and reduce it (is it called model paralelism?). For convenience, it is wrapped in this small project
https://github.com/pevnak/TrainTools.jl, which paralelizes construction of minibatches as well. We have succesfully tested this scenario and it was working reasonably well.
As the project evolves, we have in our models a special string nodes containing URLs, filepath, which are expanded inside the application of the model. When we use this expansion, the multi-threadding stops working and everything is effectively calculated on a single threads. Therefore the obvious question I want to ask, is if regular expressions are compatible with threadding? I use Julia 1.3.0-rc3.0.
Would https://github.com/BioJulia/Automa.jl be compatible with multi-threading?
Thanks for answer in advance.