Flux.jacobian(::Chain, ::AbstractArray) gives the full jacobian of a neural network. Flux.hessian however throws the error “output is not scalar”. Let m = Chain(Dense(5,3,elu), Dense(3,3)) . What I can do is compute the gradient of each value in the jacobian matrix w.r. to each input using Flux.gra…

Is there an efficient way to compute the Hessian of a NN?

HenriDeh August 5, 2019, 2:26pm 8

Ha okay ! Great, thank you I’ll keep track of the progress then !

1 Like

Topic		Replies	Views
Hessian matrix of a neural network vetor output Specific Domains physics , zygote , neural-network	3	468	July 16, 2022
Apply hessian of neural network to array Machine Learning	2	406	March 20, 2021
Batched gradients and hessians with Flux Machine Learning question	10	271	January 25, 2025
Errors when trying to compute hessian of flux neural net and jacobian of jacobian with zygote Machine Learning flux , zygote	1	392	July 4, 2022
[Flux] Issue while computing Hessian MethodError: objects of type Tracker.Grads are not callable Machine Learning flux	12	1410	August 28, 2019