# \[ANN\] New organization: JuliaGenAI for advancing generative AI tooling

**URL:** <https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114>\
**Category:** Community\
**Tags:** announcement, ai\
**Created:** [February 12, 2024, 7:43pm UTC](https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114 "2024-02-12T19:43:17Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![cpfiffer](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/cpfiffer/32/208747_2.png) [@cpfiffer](https://discourse.julialang.org/u/cpfiffer)\
**Post date:** [February 12, 2024, 7:43pm UTC](https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114/1 "2024-02-12T19:43:17Z")

</div>

I’d like to announce the [JuliaGenAI organization](https://juliagenai.org/)!

A few of us (@svilupp, @sethaxen, Brian Chen) have been discussing the use of Julia in a generative AI world. We’re focused on providing and supporting libraries that make it easy and interesting to work with generative models. It’s a new organization and we’re looking for ideas and community involvement!

I personally was inspired by @svilupp’s suite of incredible packages, like [PromptingTools.jl](https://github.com/svilupp/PromptingTools.jl), [LLMTextAnalysis.jl](https://github.com/svilupp/LLMTextAnalysis.jl), and [AIHelpMe.jl](https://github.com/svilupp/AIHelpMe.jl). Many of this is also built on top of the wonderful [OpenAI.jl](https://github.com/JuliaML/OpenAI.jl), which provides easy support for OpenAI APIs.

We want to support development of interconnects with tools in external languages, like [llama.cpp](https://github.com/ggerganov/llama.cpp), [ggml](https://github.com/ggerganov/ggml), [ollama](https://github.com/ollama/ollama), and others. I personally use Julia for many generative AI tasks and the richer the support for these, the better off the community will be. It’s a weird-ass new world and I’m looking forward to the community embracing and applying generative tools to our favorite language.

I think many of us in the Julia community are in agreement that it will be difficult to compete with other languages as far as training neural nets are concerned, and the Julia-native inference tooling for transformers are still relatively undeveloped (though improving!). I would love to see this happen and will try to provide support where I can, but that’s not the primary focus of the organization.

Our hope is that the JuliaGenAI organization can be a home for:

- Tools to develop AI agents, handle chain of thought, etc. Think something like a native [LangChain](https://www.langchain.com/). I’m still tinkering/experimenting with this at [colang](https://github.com/mind-co/colang), but I would love to see all kinds of other tools.
- Experiment with things like structured text generation. [outlines](https://github.com/outlines-dev/outlines) does this really well, and it may be worth our time to add a Julia wrapper around it.
- Other stuff yet to be determined (please make suggestions!)

You can check out the [GitHub organization](https://github.com/JuliaGenAI/juliagenai.org) or [our website](https://juliagenai.org/). We have slack and Zulip channels `#generative-ai` where you can find us.

Thanks!

---

<div class="post-metadata">

**Author:** ![kdpsingh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/kdpsingh/32/215018_2.png) [@kdpsingh](https://discourse.julialang.org/u/kdpsingh)\
**Post date:** [February 12, 2024, 10:19pm UTC](https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114/2 "2024-02-12T22:19:28Z")

</div>

I love this and can’t wait to see what you all accomplish (and look forward to contributing down the road)!

---

<div class="post-metadata">

**Author:** ![CarloLucibello](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/carlolucibello/32/3278_2.png) [@CarloLucibello](https://discourse.julialang.org/u/CarloLucibello)\
**Post date:** [February 13, 2024, 7:10am UTC](https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114/3 "2024-02-13T07:10:53Z")

</div>

I think until we get some backing from big companies for developing deep learning frameworks, interoperability is the way to go, so I really appreciate this initiative.

Maybe you would be interested in adopting this repo

> **[GitHub - CarloLucibello/HuggingFaceDatasets.jl: A Julia package for...](https://github.com/CarloLucibello/HuggingFaceDatasets.jl)**
>
> A Julia package for interacting with the Hugging Face dataset repository. - CarloLucibello/HuggingFaceDatasets.jl

It is fully functional and needs very low maintenance, but maybe needs more battlefield testing.

---

<div class="post-metadata">

**Author:** ![photor](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/photor/32/14343_2.png) [@photor](https://discourse.julialang.org/u/photor)\
**Post date:** [February 13, 2024, 7:57am UTC](https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114/4 "2024-02-13T07:57:49Z")

</div>

cool!

---

<div class="post-metadata">

**Author:** ![svilupp](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/svilupp/32/34933_2.png) [@svilupp](https://discourse.julialang.org/u/svilupp)\
**Post date:** [February 18, 2024, 1:24pm UTC](https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114/5 "2024-02-18T13:24:32Z")

</div>

This is great! I wasn’t aware of it.

Would you like to open a PR to add it to our [awesome list](https://github.com/svilupp/awesome-generative-ai-meets-julia-language) ?

---

<div class="post-metadata">

**Author:** ![narawat](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/narawat/32/30988_2.png) [@narawat](https://discourse.julialang.org/u/narawat)\
**Post date:** [February 19, 2024, 12:55pm UTC](https://discourse.julialang.org/t/ann-new-organization-juliagenai-for-advancing-generative-ai-tooling/110114/6 "2024-02-19T12:55:11Z")

</div>

Wow, many thanks to all of you for doing this. I too, hope more people consider Julia for LLM works as I really don’t want to use python or any other language tbh.
