Currently, cpu(optimiser) won’t move it. For instance, the state still consists of variables in GPU.

Getting what you want here might require a bit of extra effort. Flux’s current optimizers use IdDicts to map weights to optimizer state and when you move parameters to and from the gpu you create new copies. Result is that the IdDict will not recoginize them as the same weighs and instead you have …

How to move optimiser from gpu to cpu?

Specific Domains Machine Learning

ToucheSir December 12, 2021, 6:29pm 11

So it turns out there is an easier way to go about this, see Deepcopy Flux Model - #9 by ToucheSir.

Topic		Replies	Views
Flux.jl: Save model and optimizer from gpu Machine Learning question	1	448	November 9, 2022
Deepcopy Flux Model Machine Learning question	8	1509	December 12, 2021
Flux.jl: training fails at GPU but works on CPU Machine Learning gpu , flux	1	630	September 19, 2019
Data Science lessons: Making "10 - Neural Networks" run on GPU? New to Julia gpu , flux	4	740	January 14, 2022
Flux training GPU vs CPU different results Machine Learning gpu , flux	7	1173	August 20, 2020

How to move optimiser from gpu to cpu?

Related topics