Blog post: Free AI Tools for Coding in Julia - Disappointing Results

I wrote a blog post about the usefulness of AI chatbots for coding in Julia. It considers ChatGPT-4 (through Phind), ChatGPT3.5, Claude-2, Bard, and LLaMA2-70b.

Overall, the conclusion is that AI tools perform worse relative to more popular languages.

I was motivated by the recent post on how to make Julia more popular, along with the drop in users of StackOverFlow due to ChatGPT (this has led StackOverFlow to recently announce Overflow AI). I was thinking that if people start to rely on AI chatbots to learn programming languages, the relatively low performance of AI tools may affect the popularity of Julia.

Hope you find the post interesting!

7 Likes