Update – using latest Flux. I’d like to optimize a function of the singular values of a matrix. The Flux training loop barfs. Here’s my code using Flux, ForwardDiff, LinearAlgebra, GenericLinearAlgebra m = 20 X = randn(m,m) model = Dense(m,m) loss(X) = sum(GenericLinearAlgebra.svdvals(model(X))) …

Here’s how you can get the gradient working: using Flux, Zygote, ForwardDiff using GenericLinearAlgebra: svdvals svdvals2(X) = Zygote.forwarddiff(svdvals, X) m = 20 X = randn(m,m) model = Dense(m,m) loss(X) = sum(svdvals2(X)) ## nuclear norm loss(X) gradient(loss, X) This plugs in forwarddiff …

Using Flux to optimize a function of the Singular Values

Specific Domains Optimization (Mathematical)

baggepinnen May 18, 2020, 10:57am 2

Welcome to this forum! See this post

to make the code more readable

2 Likes

Topic		Replies	Views
Need help getting started with FluxML Machine Learning flux	5	1016	November 25, 2019
Find gradient of a posterior Statistics question	12	1026	May 16, 2019
Help with gradient Machine Learning flux	6	1210	January 31, 2020
Flux differentiation error Machine Learning zygote	19	1711	November 19, 2020
Another error with defining Flux.jl gradients Machine Learning first-steps , flux	5	1675	December 5, 2018

Using Flux to optimize a function of the Singular Values

Related topics