I’m excited to announce GitHub - 01-ai/HumanEval.jl: Evaluate LLM-synthesized @JuliaLang code. . The project is the Julia version of openai/human-eval. I hope it will help Julia developers gain a better understanding of the latest LLMs.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
[ANN] Julia LLM Leaderboard - Help us make it more relevant for every day problems! | 22 | 3449 | April 5, 2024 | |
Fine-tuning an LLM for Julia, updates | 1 | 678 | December 31, 2024 | |
A new LLM benchmark for Julia programming | 0 | 184 | May 21, 2025 | |
An LLM fine-tuned for Julia, call for comments + help | 30 | 3053 | May 20, 2024 | |
[ANN] Introducing LLMAccess: A Simple Julia Wrapper for LLM REST APIs | 4 | 459 | February 12, 2025 |