I’m excited to announce GitHub - 01-ai/HumanEval.jl: Evaluate LLM-synthesized @JuliaLang code. . The project is the Julia version of openai/human-eval. I hope it will help Julia developers gain a better understanding of the latest LLMs.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| [ANN] Julia LLM Leaderboard - Help us make it more relevant for every day problems! | 22 | 3525 | April 5, 2024 | |
| LLM AI just for Julia? A proposal: Julia *plus* science LLM? | 4 | 1616 | June 24, 2023 | |
| AI tools to write (Julia) code (best/worse experience), e.g. ChatGPT, GPT 3.5 | 62 | 15889 | May 14, 2024 | |
| An LLM fine-tuned for Julia, call for comments + help | 31 | 3328 | July 16, 2025 | |
| Are there efforts to improve ChatGPT for Julia code? | 26 | 3953 | July 24, 2023 |