LLaMA.cpp [1] has been getting a lot of attention on Hacker News [2] for its ability to run a Large Language Model (LLM) on any recent CPU with modest memory requirements. I’ve been meaning to get a better understanding of LLMs, so porting LLaMA over to Julia and being able to run it on my laptop s…

LLaMA in Julia?

ImreSamu August 7, 2023, 7:32am 12

-Ofast -march=native ....

Sequence language models in Julia

Topic		Replies	Views
Sequence language models in Julia Machine Learning	3	181	June 29, 2025
LlaMa2 architecture in Julia: llama2.jl (300 lines?) General Usage	2	521	August 1, 2023
Is Rust (and/or Python) the new high-level API (here ANN/GGUF/LLama example) Offtopic	1	308	October 26, 2024
Llamafile/tinyBLAS, and Julia small-install/binary challenge Offtopic	0	290	August 14, 2024
Run the Gemma 2 9B LLM in Julia and without a GPU? Machine Learning kaggle , llm	5	349	April 2, 2025