Dear all, I want to put the gradient of neural network (i.e., the gradient of NN output w.r.t input) in the loss function. However, it seems that Zygote cannot differentiate that. Here is my code: using Flux using Zygote using Random Xtrain = rand(Float32,(4,100)); Ytrain = rand(Float32,(1,100));…

How to use gradient of neural network as the loss function?

mkalia94 March 23, 2021, 12:38pm 11

Perhaps @ChrisRackauckas could help out here?

Is it possible to do Nested AD ~elegantly~ in Julia? (PINNs)

Topic		Replies	Views
Loss functions that involve gradients Machine Learning	4	599	November 22, 2022
Gradient error in Flux model inputs Machine Learning question , flux , zygote	5	1303	January 13, 2021
Divergence loss term Partial Derivative Flux Zygote Machine Learning question , flux , zygote	0	250	October 28, 2023
Flux/Zygote: Gradient with respect to inputs and implicit parameters (in 2021) Machine Learning question , flux , zygote	1	943	November 23, 2021
Flux differentiation error Machine Learning zygote	19	1670	November 19, 2020