At the moment I implement gradients for all my models, because I have not yet found that Julia’s AD packages come anywhere close to my fairly naive hand-optimised gradients. (The only exception is ForwardDiff on very small problems when used with StaticArrays!) But every few months I explore what i…

Zygote Performance

cortner September 21, 2019, 5:02pm 5

As I said - I’m really pleased about 4x - but it’s actually nowhere near enough for my application domain.

Ich see your point though the Memory Access is missing entirely.

1 Like

Topic		Replies	Views
Allocations in Zygote for a simple derivative Machine Learning performance , zygote	0	696	February 19, 2020
Zygote dozens* of times slower than manually written function Performance zygote , forwarddiff	17	1833	April 21, 2022
Speed of vectorized vs for-loops using Zygote Performance zygote , tullio	20	2317	June 1, 2020
Allocations when constructing a matrix from columns Performance memory-allocation	35	1898	April 1, 2020
Zygote Performance (Again...) General Usage zygote , forwarddiff , tullio	17	1871	June 11, 2021