Accelerated gradient descent algorithm

Hello,
I am searching for an Example of the accelerated gradient descent Algorithm written in Julia … any recommendation?

Maybe are you looking for the Nesterov’s Accelerated Gradient Descent? I think it is implemented in Flux as Nesterov https://fluxml.ai/Flux.jl/stable/training/optimisers/#Flux.Optimise.Nesterov. The source code is available at the Flux Github page: https://github.com/FluxML/Flux.jl.

3 Likes