LLaMA.cpp [1] has been getting a lot of attention on Hacker News [2] for its ability to run a Large Language Model (LLM) on any recent CPU with modest memory requirements. I’ve been meaning to get a better understanding of LLMs, so porting LLaMA over to Julia and being able to run it on my laptop s…

LLaMA in Julia?

ImreSamu August 7, 2023, 7:32am 12

-Ofast -march=native ....

Sequence language models in Julia

Topic		Replies	Views
LlaMa2 architecture in Julia: llama2.jl (300 lines?) General Usage	2	540	August 1, 2023
Gradient of llama2 computed by Zygote seems to be incorrect Machine Learning	6	743	September 13, 2023
[ANN] Jjama3.jl (unregistered) - Llama3.1 and Llama3.2 (text) in Julia Package Announcements	9	706	December 6, 2024
Generate independent LLVM code from Julia General Usage question , llvm	0	676	April 5, 2017
OpenAL GPT Machine Learning question	0	792	March 22, 2019