# Using Julia to connect to local LLMs

**URL:** <https://discourse.julialang.org/t/using-julia-to-connect-to-local-llms/106137>\
**Category:** General Usage\
**Created:** [November 13, 2023, 5:48am UTC](https://discourse.julialang.org/t/using-julia-to-connect-to-local-llms/106137 "2023-11-13T05:48:45Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![rcheruku](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/rcheruku/32/20886_2.png) [@rcheruku](https://discourse.julialang.org/u/rcheruku)\
**Post date:** [November 13, 2023, 5:48am UTC](https://discourse.julialang.org/t/using-julia-to-connect-to-local-llms/106137/1 "2023-11-13T05:48:46Z")

</div>

I found very few examples so far, on the web, so created couple of examples:  
one for Ollama ( you can download supported HF LLMs on to your Mac/Linux and use it )  
Here is the example:

> <https://github.com/rcherukuri12/ollama_julia_code_generator/blob/main/ollama_client.jl>