Currently, cpu(optimiser) won’t move it. For instance, the state still consists of variables in GPU.

Getting what you want here might require a bit of extra effort. Flux’s current optimizers use IdDicts to map weights to optimizer state and when you move parameters to and from the gpu you create new copies. Result is that the IdDict will not recoginize them as the same weighs and instead you have …

How to move optimiser from gpu to cpu?

Specific Domains Machine Learning

ToucheSir December 12, 2021, 6:29pm 11

So it turns out there is an easier way to go about this, see Deepcopy Flux Model - #9 by ToucheSir.

Topic		Replies	Views
Flux.jl: Save model and optimizer from gpu Machine Learning question	1	464	November 9, 2022
Deepcopy Flux Model Machine Learning question	8	1542	December 12, 2021
GSoC proposal: Addition of optimisers and model loading capabilities to Flux.jl Community	0	592	April 2, 2017
Flux.jl: training fails at GPU but works on CPU Machine Learning gpu , flux	1	642	September 19, 2019
[ANN] Flux v0.5 Machine Learning	11	2165	March 15, 2018

How to move optimiser from gpu to cpu?

Related topics