I’d like to download the weighting matrices for an open source transformer model (BERT, GPT2…)
and try and do the matrix equations from scatch in Julia.
Any thoughts on the best way to do this?
ChatGPT suggested either using Python’s transformers library via PyCall or HuggingFace.jl