Pkg: private repository usage and keys

General Usage
21

Hm… I know that Windows has some weird git installation, so it’s possible that libgit and git are linked somehow, I’m not sure.

22
3 Likes
23

I’m not sure this will really work as I’m trying to build in a docker, but thanks I’m sure it’ll be helpful for something at some point.

I think my real problem is that I’m trying to do a completely automated docker build, so even though I can use the credential helper during normal circumstances I’m not sure I can us it during the build process.

I think the best of bad options is going to be simply including everything that’s needed in the docker build directly. We are upgrading out git, at that point I’ll probably just tell IT that they have to fix the pull issues because it’s getting in the way of me doing my job.

24

Possibly related and some debugging hints: https://github.com/JuliaLang/Pkg.jl/issues/1516#issuecomment-560794389

25

Had this same issue, but on macOS Catalina. I needed to add my identity with ssh-add. From bash enter:

eval $(ssh-agent)
ssh-add

Then restart Julia. After this I was able to clone no problem!

4 Likes
26

I can confirm, I was having the same issue as @ExpandingMan , but @euthoff’s solution works for me on Julia v1.6.0-beta1. Can someone explain what’s going on? This definitely seems like a Pkg bug - I’ve never had to do anything like this with any other package manager.

27

Hard to say what exactly is your problem but I’ve documented the best practice I know for ssh keys at https://github.com/GunnarFarneback/LocalRegistry.jl/blob/master/docs/ssh_keys.md#3-generating-a-compatible-key.

28

Thanks for this @GunnarFarneback. As you point out, apparently using the PEM SSH key format works, but not the default OPENSSH format (which I was using) because (quoting you)

LibGit2 gets its ssh functionality from libssh2 , which indeed is less capable of taking the ~/.ssh configurations into account than the ssh command line interface used by the git command line interface.

But it seems like @StefanKarpinski is working on improving this.

Apparently the above solution involving ssh-agent somehow makes incompatible keys available to libssh2 via an intermediary.

Just thought that summarizing the situation might be helpful for the next confused googler.

29

In general not using ssh-agent is a world of pain.
And that is sad.
https://github.com/JuliaLang/Pkg.jl/issues/911#issuecomment-769898970

1 Like
30

For what it’s worth I’ve never used ssh-agent and plain keys have worked fine at work for a long time now. (Also we’re running a package server for our internal packages these days, so the need to use ssh for packages is marginal.)

2 Likes
31

I have the same issue: my private keys are used correctly everywhere EXCEPT when adding a custom registry. Have you ever found the solution for this?

The best I’ve been able to do so far is doing registry add https://... instead of registry add git@..... This works correctly, but it’s annoying to get asked for username/password every time julia hits the registry.

32

Ok, based on this [1] I found a hack around.

Launch your julia like this:

JULIA_PKG_USE_CLI_GIT=true julia

Then this should work, at least this worked for me:

] registry add git@...

[1] stop using libgit2 · Issue #2679 · JuliaLang/Pkg.jl · GitHub

1 Like
33

Not really a hack, that’s the official way to do this.

1 Like
34

Fun fact: jujutsu, the best VCS, recently changed to using CLI git by default I think because of exactly this issue.

35

Libgit2 is not great on the client side, unfortunately.