Hi, I’m quite new to Julia and trying to understand automatic differentiation. I have a loss function for a model, and I’m trying to get the gradient and hessian w.r.t parameters fitted to the model. In doing so, comparing Zygote, ForwardDiff and ReverseDiff, I noticed that the values for the gradi…

I mentioned last time that there was an issue with uniqueness of times in the way that your model was originally posed, and you made that same issue again. If you fix that it’s fine: using DifferentialEquations, Flux, LinearAlgebra, DiffEqFlux, DiffEqSensitivity using ForwardDiff, FiniteDiff using …

Different results between Zygote, ForwardDiff, and ReverseDiff

New to Julia

Tamas_Papp September 13, 2020, 12:48pm 2

Normally, they should agree, so this can be a bug. An MWE replicating this would be helpful.

Topic		Replies	Views
ReverseDiff for loss function with Zygote derivatives Machine Learning	1	399	February 10, 2023
Taking gradients in Julia General Usage question , zygote , forwarddiff , reversediff	7	2039	September 28, 2021
Hessian matrix of ML model General Usage flux , zygote , forwarddiff , reversediff	9	2199	April 28, 2021
Avoiding redundant computation when using Zygote and ForwardDiff for forward-over-reverse hessians General Usage forwarddiff , reversediff , autodiff	4	53	March 12, 2025
Taking gradients of a matrix exponential New to Julia differentiation , gradient	10	909	January 2, 2024

Different results between Zygote, ForwardDiff, and ReverseDiff

Related topics