Hi, I’m quite new to Julia and trying to understand automatic differentiation. I have a loss function for a model, and I’m trying to get the gradient and hessian w.r.t parameters fitted to the model. In doing so, comparing Zygote, ForwardDiff and ReverseDiff, I noticed that the values for the gradi…

I mentioned last time that there was an issue with uniqueness of times in the way that your model was originally posed, and you made that same issue again. If you fix that it’s fine: using DifferentialEquations, Flux, LinearAlgebra, DiffEqFlux, DiffEqSensitivity using ForwardDiff, FiniteDiff using …

Different results between Zygote, ForwardDiff, and ReverseDiff

New to Julia

Tamas_Papp September 13, 2020, 12:48pm 2

Normally, they should agree, so this can be a bug. An MWE replicating this would be helpful.

Topic		Replies	Views
Zero gradients with Zygote vs correct gradients with ReverseDiff using DiffEqFlux Machine Learning zygote , reversediff , diffeqflux	4	1409	January 24, 2022
Zygote dozens* of times slower than manually written function Performance zygote , forwarddiff	17	1787	April 21, 2022
Compute gradient of gradient norm using zygote New to Julia zygote	17	2047	August 26, 2022
Nesting ForwardDiff inside ReverseDiff? General Usage question , differentiation	5	1290	January 4, 2018
Newbie: Gradient of a gradient performance in Zygote General Usage zygote	2	516	March 21, 2021

Different results between Zygote, ForwardDiff, and ReverseDiff

Related topics