# Microsoft Phi model

**URL:** <https://discourse.julialang.org/t/microsoft-phi-model/108895>\
**Category:** Machine Learning\
**Created:** [January 17, 2024, 8:42am UTC](https://discourse.julialang.org/t/microsoft-phi-model/108895 "2024-01-17T08:42:50Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Tomas\_Pevny](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tomas_pevny/32/25466_2.png) [@Tomas\_Pevny](https://discourse.julialang.org/u/Tomas_Pevny)\
**Post date:** [January 17, 2024, 8:42am UTC](https://discourse.julialang.org/t/microsoft-phi-model/108895/1 "2024-01-17T08:42:50Z")

</div>

Is anyone up to porting (adding) microsoft phi model to [Transformers.jl](https://github.com/chengchingwen/Transformers.jl)? I would like to use it for experiments (I am interested to make it a bert-like model). I have been using so far llama2-7b, but phi models seems smaller and good enough.