Accelerated gradient descent algorithm

Hello,
I am searching for an Example of the accelerated gradient descent Algorithm written in Julia … any recommendation?

Maybe are you looking for the Nesterov’s Accelerated Gradient Descent? I think it is implemented in Flux as Nesterov Optimisers · Flux. The source code is available at the Flux Github page: GitHub - FluxML/Flux.jl: Relax! Flux is the ML library that doesn't make you tensor.

3 Likes