@svilupp first off, thank you so much for the great work you’ve been doing with the LLM-related packages 
I would use PromptingTools.jl more often if it had a CHAT REPL mode where users could type a special character like / and start chatting without the ai"message" boilerplate:
/ # typing / as the first character in the line activates CHAT REPL mode
chat> What is the capital of Brazil?
🤖: Brasília is the capital
You can create custom REPL modes in Julia with packages like ReplMaker.jl. The example they give with a LISP REPL gives an idea of the end-user experience. It is really nice.