Hello all, I have been trying to setup NeuralODE to learn the behavior of a stiff ODE but in the process I am running into this strange error. I have tried using all Float32 values only but it seems that there is some issue with the implementation. I am new to Julia and am trying to learn so any h…

In late 2023 Optim.jl had a release that added an Adam algorithm, and to the dismay of everyone in the community, it used exactly the same name as the Optimisers.jl Adam algorithm. Both export Adam, so what you’re leaving off here is that you received a warning in your REPL that said you need to dis…

I believe you’re trying to do something similar to this blog post: Weather forecasting with neural ODEs · DiffEqFlux.jl Documentation for DiffEqFlux.jl. so it may serve as a better guide than whatever older example you’re looking at.

Thanks @oheil and @ChrisRackauckas the code is running now. However, it seems as if the model is not able to learn. Any suggestions on how to improving the training process? Viven

Lower tolerances or learning rate?

It is getting stuck at some local minima (see plot below). All other parameters are same as that in the initial code. # shaping information for the NN math_law(x) = 1000.0*x.^5 [image] Thanks Viven

That doesn’t look like a local optima. I’d look for other issues, like saturating loss functions.

MethodError: no method matching Adam(::Float64)

General Usage

oheil March 23, 2024, 9:36am 2

Have a look here: Optimizer not found error

Topic		Replies	Views
Error using example for NeuralODE General Usage optimization , neural-network	4	154	October 25, 2024
Error when a neural ode is implemented Machine Learning sciml , neural-network , lux	3	199	May 2, 2025
Question and error about optimization for Nueral ode Optimization (Mathematical) question	1	104	March 2, 2025
How can I speed up my Neural ODE? Performance question , diffeq , flux , neural-network	4	926	July 20, 2021
NeuralODE Loss function constrain optimization General Usage package , diffeq , optimization , neural-network , differentialequation	19	730	March 18, 2023

MethodError: no method matching Adam(::Float64)

Related topics