Julia now has so many different autodiff packages. Can somebody summarize the status of these packages? From what I know, there is Forwarddiff (which uses dual numbers), and then there is the Reversediff, which I’m not sure about. Then there is Zygote, which is said to be quite good and general, En…

[image] State of AD in 2024 General Usage Hi, I’m new to the Julia language and am trying to understand the AD ecosystem. From what I understand, Julia wants to broaden AD beyond the type of models you might find in Pytorch and Jax while also retaining similar performance…

Comparison of Julia autodiff packages

General Usage

nilshg September 27, 2024, 2:38pm 2

2 Likes

Topic		Replies	Views
State of AD in 2024 General Usage machine-learning , autodiff	4	2245	April 6, 2024
Which autodiff to currently use for a neural network backend? General Usage package , statistics , machinevision	10	2162	October 1, 2018
What lessons could Julia's autodiff ecosystem learn from Stan's TinyGrad? Machine Learning	41	3829	September 13, 2023
Taking gradients in Julia General Usage question , zygote , forwarddiff , reversediff	7	2125	September 28, 2021
Automatic Differentiation (AD) in Julia vs. Python (or PyTorch) Machine Learning autodiff	14	1543	January 16, 2025

Comparison of Julia autodiff packages

Related topics