Hi all, I built a custom nn model UnetSkipGenerator, trained it and needed to save the results, therefore I used Flux.destructure and saved the parameters it returned. Now I am trying to do some computations with them, but I noticed a behaviour that I cannot explain. When I try to copy values of pa…

What exactly Flux.destructure does?

Avec March 15, 2022, 8:52am 7

Just to close this up, the problem was caused by nontrainable parameters in BatchNorm. Flux.params contains only trainable parameters, so the nontrainbale ones were not copied.

Topic		Replies	Views
Why is Flux.destructure type unstable? Machine Learning package , flux	6	382	March 25, 2024
Can I reconstruct a network using Flux.params in Flux.jl? Machine Learning flux , machine-learning , neural-network	2	677	November 20, 2022
How to create a Flux model from parameter vector? New to Julia flux	3	713	January 6, 2021
Hypernetworks using Flux.destructure? Machine Learning flux , zygote	10	854	July 11, 2022
DiffEqFlux.sciml_train resulting parameters General Usage question	4	665	April 29, 2020

What exactly Flux.destructure does?

Related topics