Two questions on Flux

[baggepinnen]

For those still interested in using BFGS (or L-BFGS) to train flux models, I made a small utility package to facilitate this

[ANN] FluxOptTools

FluxOptTools.jl This package contains some utilities to enhance training of Flux.jl models. Train using Optim Optim.jl can be used to train Flux models (if Flux is on branch sf/zygote_updated), here’s an example how using Flux, Zygote, Optim, FluxOptTools, Statistics m = Chain(Dense(1,3,tanh) , Dense(3,1)) x = LinRange(-pi,pi,100)' y = sin.(x) loss() = mean(abs2, m(x) .- y) Zygote.refresh() pars = Flux.params(m) lossfun, gradfun, fg!, p0 = optfuns(loss, pars) res = Optim.opti…