# Downloading transformer weights

**URL:** <https://discourse.julialang.org/t/downloading-transformer-weights/122893>\
**Category:** General Usage\
**Tags:** tensorflow, flux, machine-learning, transformers\
**Created:** [November 21, 2024, 12:26pm UTC](https://discourse.julialang.org/t/downloading-transformer-weights/122893 "2024-11-21T12:26:12Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lincoln\_Hannah](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/lincoln_hannah/32/19198_2.png) [@Lincoln\_Hannah](https://discourse.julialang.org/u/Lincoln_Hannah)\
**Post date:** [November 21, 2024, 12:26pm UTC](https://discourse.julialang.org/t/downloading-transformer-weights/122893/1 "2024-11-21T12:26:12Z")

</div>

I’d like to download the weighting matrices for an open source transformer model (BERT, GPT2…)  
and try and do the matrix equations from scatch in Julia.

Any thoughts on the best way to do this?

ChatGPT suggested either using Python’s transformers library via PyCall or HuggingFace.jl