Is anyone up to porting (adding) microsoft phi model to Transformers.jl? I would like to use it for experiments (I am interested to make it a bert-like model). I have been using so far llama2-7b, but phi models seems smaller and good enough.
2 Likes