Using Julia to connect to local LLMs

General Usage
1

I found very few examples so far, on the web, so created couple of examples:
one for Ollama ( you can download supported HF LLMs on to your Mac/Linux and use it )
Here is the example:

4 Likes