I really like the direction of this project. Getting a small GPT-style model running end-to-end in Julia, including training, tokenization, artifacts, and the REPL workflow, is a useful proof of concept.
The offline side of software is also an interesting area to explore, especially for tools that need to remain usable without a constant internet connection. I’ve been looking into the “Offline Mode” concept as well, and I’ve documented some related ideas here:
It would be interesting to see where KeemenaLM.jl goes next, particularly around local/offline inference, model optimization, and making the workflow easier for Julia users.