Does anyone know some good way to benchmark my loss function trained with sciml_train using different optimizers? Just like the way that WorkPrecisionSet() can do to show the performance differences due to using different algorithms as below:
setups = [Dict(:alg=>BS3()),
Dict(:alg=>Tsit5()),
Dict(:alg=>RK4()),
Dict(:alg=>DP5()),]
wp = WorkPrecisionSet(prob,abstols,reltols,setups;
appxsol=test_sol,maxiters=Int(1e5),error_estimate=:L2)
plot(wp)
Is there some suitable function to treat my loss as argument to do so?
By the way, if you are familiar with sciml_train, could you also recommend me some other fast optimizers like ADAM?