I have the following custom layer. struct Activation{F} f::F Activation(f::Function) = new{typeof(f)}(f) end (m::Activation)(x::AbstractArray) = m.f.(x) I test whether it allows a model to be trained using the following code using Flux function test_training(model,x,y) opt = Descent(…

My mistake, I thought the @info logging was unconditional for some reason. In that case, my working theory would be that all the updates from the previous calls to test_training leave the weights of test_layer on some kind of local minima or saddle point by the time it reaches the activation test. T…

Parameters not updating in Flux

Specific Domains Machine Learning

a-ill July 9, 2021, 3:11pm 21

Declaring test_layer for each test did solve the problem. Thanks!

1 Like

Topic		Replies	Views
Params not getting updated during training New to Julia flux	25	1897	October 11, 2020
Custom Flux.jl Layer Not Updating (problem with Flux.trainable?) Machine Learning flux	2	273	October 19, 2024
How to use Flux.train! to train custom layer? Machine Learning question	2	1851	September 2, 2019
Flux.jl changes in api General Usage	2	236	March 17, 2023
Custom layer with new parameters in Flux.jl Machine Learning flux	3	1584	December 11, 2019

Parameters not updating in Flux

Related topics