Hi, I’m quite new to Julia and trying to understand automatic differentiation. I have a loss function for a model, and I’m trying to get the gradient and hessian w.r.t parameters fitted to the model. In doing so, comparing Zygote, ForwardDiff and ReverseDiff, I noticed that the values for the gradi…

I mentioned last time that there was an issue with uniqueness of times in the way that your model was originally posed, and you made that same issue again. If you fix that it’s fine: using DifferentialEquations, Flux, LinearAlgebra, DiffEqFlux, DiffEqSensitivity using ForwardDiff, FiniteDiff using …

Different results between Zygote, ForwardDiff, and ReverseDiff

New to Julia

Tamas_Papp September 13, 2020, 12:48pm 2

Normally, they should agree, so this can be a bug. An MWE replicating this would be helpful.

Topic		Replies	Views
ReverseDiff for loss function with Zygote derivatives Machine Learning	1	394	February 10, 2023
Taking gradients in Julia General Usage question , zygote , forwarddiff , reversediff	7	1989	September 28, 2021
Hessian matrix of ML model General Usage flux , zygote , forwarddiff , reversediff	9	2161	April 28, 2021
Taking gradients of a matrix exponential New to Julia differentiation , gradient	10	889	January 2, 2024
Zygote hessian New to Julia zygote	3	1696	August 10, 2020

Different results between Zygote, ForwardDiff, and ReverseDiff

Related topics