With SIMD the CPU may execute the same instructions on e.g. 4x differents datasets just as fast as on 1x dataset. Assuming the user has a SIMD-enabled objective function - are there optimization algos that can exploit that? E.g. in Optim, Roots, SciML…? The prime example would be the BiSection alg…

The tools don’t have an interface for it yet. But I was just chatting with @Elrod about doing this just last week. We’ll probably start doing some of this for all SciML problems once the GPU push is done this summer (there’s new algorithms in each area to be made for this). If you’re interested and …

Supporting SIMD-enabled objective functions in optimization APIs

Specific Domains Optimization (Mathematical)

odow February 5, 2024, 6:59pm 3

Topic		Replies	Views
JuliaOpt parallel algorithms Optimization (Mathematical) first-steps	7	3935	August 1, 2017
Questions on a number of code acceleration techniques General Usage performance , hpc , parallel	11	1796	July 8, 2017
Is it possible to use @simd with multiple variable loop? Julia at Scale question , simd , parallel	5	882	September 4, 2017
Is it possible to use SIMD in multithreading? General Usage performance	5	1657	June 28, 2021
Optim package in parallel Optimization (Mathematical) question	0	583	May 13, 2019

Supporting SIMD-enabled objective functions in optimization APIs

Related topics