How to add a package from github to test it

New to Julia
1

Hello I wanna use and clone the following github project GitHub - svilupp/Julia-LLM-Leaderboard: Provides a platform for the Julia community to compare AI models' abilities in generating syntactically correct Julia code, featuring structured tests and automated evaluations for easy and collaborative benchmarking.
Here is my steps:
1 - git clone GitHub - svilupp/Julia-LLM-Leaderboard: Provides a platform for the Julia community to compare AI models' abilities in generating syntactically correct Julia code, featuring structured tests and automated evaluations for easy and collaborative benchmarking.
2 - cd(“/Users/abdhu99/JuliaMetaOpt”)
3 - using Pkg; Pkg.activate(“.”)
4 - Pkg.instantiate()
5 - Pkg.add(“JuliaLLMLeaderboard”)
6 - using JuliaLLMLeaderboard
I get the following error
ERROR: ArgumentError: Package JuliaLLMLeaderboard not found in current path.

  • Run import Pkg; Pkg.add(“JuliaLLMLeaderboard”) to install the JuliaLLMLeaderboard package.
    Stacktrace:
    [1] macro expansion
    @ ./loading.jl:1163 [inlined]
    [2] macro expansion
    @ ./lock.jl:223 [inlined]
    [3] require(into::Module, mod::Symbol)
    @ Base ./loading.jl:1144
    if I try to add it as follows:
    Pkg.add(“JuliaLLMLeaderboard”)
    I get the following

The following package names could not be resolved:

  • JuliaLLMLeaderboard (not found in project, manifest or registry)
    Stacktrace:
    [1] pkgerror(msg::String)
    @ Pkg.Types /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/Types.jl:67
    [2] ensure_resolved(ctx::Pkg.Types.Context, manifest::Pkg.Types.Manifest, pkgs::Vector{Pkg.Types.PackageSpec}; registry::Bool)
    @ Pkg.Types /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/Types.jl:952
    [3] add(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; preserve::Pkg.Types.PreserveLevel, platform::Base.BinaryPlatforms.Platform, kwargs::Base.Pairs{Symbol, Base.TTY, Tuple{Symbol}, NamedTuple{(:io,), Tuple{Base.TTY}}})
    @ Pkg.API /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/API.jl:264
    [4] add(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.TTY, kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
    @ Pkg.API /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/API.jl:156
    [5] add(pkgs::Vector{Pkg.Types.PackageSpec})
    @ Pkg.API /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/API.jl:145
    [6] #add#27
    @ /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/API.jl:144 [inlined]
    [7] add
    @ /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/API.jl:144 [inlined]
    [8] #add#26
    @ /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/API.jl:143 [inlined]
    [9] add(pkg::String)
    @ Pkg.API /Applications/Julia-1.8.app/Contents/Resources/julia/share/julia/stdlib/v1.8/Pkg/src/API.jl:143
    [10] top-level scope
    @ REPL[26]:1
    Any help?
2

Instead of step 5, did you try:
pkg"add https://github.com/svilupp/Julia-LLM-Leaderboard"

And then you do not need step one.

3

it gives me an error

4

Which error?

5

Screenshot 2024-09-16 at 15.54.41
Screenshot 2024-09-16 at 15.54.412398Ă—572 63.3 KB

6

I think the error message is clear:
You must do using Pkg first. As you did in step 3.

And your second try would have worked, if you would have omitted the quotes.

1 Like
7

Still have the following

Screenshot 2024-09-16 at 16.18.51
Screenshot 2024-09-16 at 16.18.512212Ă—1196 436 KB

8

This is a different question. If you share the output of

using Pkg
Pkg.status()

as text (not as screenshot), we might be able to help you to debug this dependency problem.
Packages from Github are more likely to have dependency problems than packages that are registered.

I see that you are using the OpenModelica registry. Do you need that for this project?

9

It gives me only one package. Here is the output
Jacobi v0.7.0

No it is for different project.

10

Please, use per-project Project.toml files as explained here: Working with Julia projects | Julia programming notes . That is the only way to minimize the risk of broken dependencies.

If I do:

mkdir test
cd test
julia --project="."
using Pkg
pkg"add https://github.com/svilupp/Julia-LLM-Leaderboard"

This installs cleanly without any error.

If you get an error you must have other packages in your environment. And if you have Jacobi in your environment and don’t need it, just remove it.

1 Like
11

Thanks a lot
I do the above steps and I searched for the dependencies
I have already installed

but i didn’t success

12

What is the error message?

What is the output of

using Pkg
Pkg.status()