@ChrisRackauckas Thank you very much! I will try it! Is there some example, how to put user-defined loss function with Flux neural networks inside to GalacticOptim.jl?
PS: I make it work using my implementation of ADAM that manually de-dualize gradient. Thank you for your guidance!
