LLaMA.cpp [1] has been getting a lot of attention on Hacker News [2] for its ability to run a Large Language Model (LLM) on any recent CPU with modest memory requirements. I’ve been meaning to get a better understanding of LLMs, so porting LLaMA over to Julia and being able to run it on my laptop s…

LLaMA in Julia?

ImreSamu August 7, 2023, 7:32am 12

-Ofast -march=native ....

Sequence language models in Julia

Topic		Replies	Views
LlaMa2 architecture in Julia: llama2.jl (300 lines?) General Usage	2	536	August 1, 2023
[ANN] Jjama3.jl (unregistered) - Llama3.1 and Llama3.2 (text) in Julia Package Announcements	9	697	December 6, 2024
Sequence language models in Julia Machine Learning	6	325	August 18, 2025
Run the Gemma 2 9B LLM in Julia and without a GPU? Machine Learning kaggle , llm	5	370	April 2, 2025
Gradient of llama2 computed by Zygote seems to be incorrect Machine Learning	6	734	September 13, 2023