[ANN] New organization: JuliaGenAI for advancing generative AI tooling

I’d like to announce the JuliaGenAI organization!

A few of us (@svilupp, @sethaxen, Brian Chen) have been discussing the use of Julia in a generative AI world. We’re focused on providing and supporting libraries that make it easy and interesting to work with generative models. It’s a new organization and we’re looking for ideas and community involvement!

I personally was inspired by @svilupp’s suite of incredible packages, like PromptingTools.jl, LLMTextAnalysis.jl, and AIHelpMe.jl. Many of this is also built on top of the wonderful OpenAI.jl, which provides easy support for OpenAI APIs.

We want to support development of interconnects with tools in external languages, like llama.cpp, ggml, ollama, and others. I personally use Julia for many generative AI tasks and the richer the support for these, the better off the community will be. It’s a weird-ass new world and I’m looking forward to the community embracing and applying generative tools to our favorite language.

I think many of us in the Julia community are in agreement that it will be difficult to compete with other languages as far as training neural nets are concerned, and the Julia-native inference tooling for transformers are still relatively undeveloped (though improving!). I would love to see this happen and will try to provide support where I can, but that’s not the primary focus of the organization.

Our hope is that the JuliaGenAI organization can be a home for:

  • Tools to develop AI agents, handle chain of thought, etc. Think something like a native LangChain. I’m still tinkering/experimenting with this at colang, but I would love to see all kinds of other tools.
  • Experiment with things like structured text generation. outlines does this really well, and it may be worth our time to add a Julia wrapper around it.
  • Other stuff yet to be determined (please make suggestions!)

You can check out the GitHub organization or our website. We have slack and Zulip channels #generative-ai where you can find us.

Thanks!

42 Likes

I love this and can’t wait to see what you all accomplish (and look forward to contributing down the road)!

5 Likes

I think until we get some backing from big companies for developing deep learning frameworks, interoperability is the way to go, so I really appreciate this initiative.

Maybe you would be interested in adopting this repo

It is fully functional and needs very low maintenance, but maybe needs more battlefield testing.

6 Likes

cool!

1 Like

This is great! I wasn’t aware of it.

Would you like to open a PR to add it to our awesome list ?

1 Like

Wow, many thanks to all of you for doing this. I too, hope more people consider Julia for LLM works as I really don’t want to use python or any other language tbh.

2 Likes