Hi there, I am pretty new to anything related to this topic in general, but I found Flux to be quite accessible and wanted to have a look at the Transformers.jl package as well. I’ve been playing around with the copy task (the toy example found here: Transformers.jl/example/AttentionIsAllYouNeed at…

They are in the trf_model. trf_model is just a model wrapper wrapping those embed, encoder etc. You should be able to access those model in trf_model’s field. (or you can just save embed/encoder/… instead.)

Saving a model built with Transformers.jl

Specific Domains Machine Learning

chengchingwen March 15, 2023, 12:59pm 2

What error did you get?

1 Like

Topic		Replies	Views
Unable to save and load model (or parameters) with BSON either on GPU or CPU Machine Learning gpu , cuda , flux , bson	2	1268	July 15, 2021
Flux cannot save a parameters Machine Learning flux , bson	3	814	March 16, 2020
Unable to save simple FLUX model with BSON Machine Learning	2	598	October 8, 2019
Loading a trained model in Transformers.jl General Usage question , flux , transformers	0	374	September 25, 2023
Qs about trained model: (1) testmode! vs excluding Dropout layers; (2) size of BSON file Machine Learning	3	338	October 11, 2021

Saving a model built with Transformers.jl

Related topics