# BERT models from huggingface - Transformers.jl

**URL:** <https://discourse.julialang.org/t/bert-models-from-huggingface-transformers-jl/64453>\
**Category:** Machine Learning\
**Tags:** package\
**Created:** [July 11, 2021, 7:54am UTC](https://discourse.julialang.org/t/bert-models-from-huggingface-transformers-jl/64453 "2021-07-11T07:54:20Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Alex\_Tantos](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/alex_tantos/32/10636_2.png) [@Alex\_Tantos](https://discourse.julialang.org/u/Alex_Tantos)\
**Post date:** [July 11, 2021, 7:54am UTC](https://discourse.julialang.org/t/bert-models-from-huggingface-transformers-jl/64453/1 "2021-07-11T07:54:20Z")

</div>

Hi!

@chengchingwen

Am planning to use an already pre-trained BERT model for Greek published in huggingface. As we know for using this type of pre-trained models, one depends on python’s hugginface and pytorch. I know that @chengchingwen has been doing some exciting work with Transformers.jl. I really appreciate the effort he puts on this!

On the package’s page stays “Current we only support a few model and the tokenizer part is not finished yet.” Any news on the front?

Thanks!

Alex

---

<div class="post-metadata">

**Author:** ![chengchingwen](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/chengchingwen/32/8390_2.png) [@chengchingwen](https://discourse.julialang.org/u/chengchingwen)\
**Post date:** [July 15, 2021, 10:50pm UTC](https://discourse.julialang.org/t/bert-models-from-huggingface-transformers-jl/64453/2 "2021-07-15T22:50:32Z")

</div>

Hi,

If it is a BERT model with different weight, it should be workable, but not fully automatic. For the question, there are some progress taking place at different repo but haven’t get integrated together.