Hi everyone,
I recently came across TOON (Token-Oriented Object Notation), which is described as a data format designed to be more LLM-friendly than JSON. The format aims to reduce token usage while maintaining readability and type safety.
Some interesting features:
- Compact syntax that reduces LLM token consumption
- Built-in type annotations
- Object-oriented structure
- There’s an interactive playground to explore how it compares to JSON in terms of tokenization
There’s already a Python implementation available, which got me thinking about Julia.
Has anyone:
- Heard of or worked with TOON format?
- Started (or would be interested in) a Julia implementation?
Given Julia’s strengths in parsing and the growing interest in LLM applications, it seems like TOON could be a useful addition to the ecosystem. I’m curious if there’s any existing work in this direction or if others think this would be a valuable package to develop.
Would love to hear your thoughts!