# Training sentence transformers in Julia?

**URL:** <https://discourse.julialang.org/t/training-sentence-transformers-in-julia/71460>\
**Category:** Machine Learning\
**Tags:** question, transformers, sbert, bert, sentence-transformer\
**Created:** [November 14, 2021, 3:57pm UTC](https://discourse.julialang.org/t/training-sentence-transformers-in-julia/71460 "2021-11-14T15:57:45Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Alex\_Tantos](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/alex_tantos/32/10636_2.png) [@Alex\_Tantos](https://discourse.julialang.org/u/Alex_Tantos)\
**Post date:** [November 14, 2021, 3:57pm UTC](https://discourse.julialang.org/t/training-sentence-transformers-in-julia/71460/1 "2021-11-14T15:57:45Z")

</div>

Hi!

Has anyone tried to train a sentence transformer by fine tuning BERT in julia following the method of the 2019 [paper](https://arxiv.org/abs/1908.10084) on sentence transformers (and the model is called SBERT)? I know this is too general a question, but what I would hopefully like to get from this post are responses with repos or tutorials that exemplify the process.  
In python, you can either use pytorch of use the library sentencetransformers.

Any response is greatly appreciated!

Alex