I’m excited to announce GitHub - 01-ai/HumanEval.jl: Evaluate LLM-synthesized @JuliaLang code. . The project is the Julia version of openai/human-eval. I hope it will help Julia developers gain a better understanding of the latest LLMs.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
[ANN] Julia LLM Leaderboard - Help us make it more relevant for every day problems! | 22 | 3565 | April 5, 2024 | |
LLM AI just for Julia? A proposal: Julia *plus* science LLM? | 4 | 1629 | June 24, 2023 | |
Julia code generation LLM models? | 4 | 318 | August 30, 2025 | |
AI tools to write (Julia) code (best/worse experience), e.g. ChatGPT, GPT 3.5 | 62 | 16039 | May 14, 2024 | |
An LLM fine-tuned for Julia, call for comments + help | 31 | 3423 | July 16, 2025 |