Pkg: 60s lag

I will preface this post by saying that I doubt this could have anything to do with Pkg.jl or julialang.org.

However, this is what I observe (numbers are seconds since start of build stage):

So it pulls 8 items and then waits ~60 seconds. JULIA_NUM_THREADS is 8 and this section of Pkg.jl is asynchronous, so I interpret that there is something adding a 60 second delay to each request.

I am doing this from behind a firewall and there is basically unknown network infrastructure between me and the wider internet. Does anyone know what questions I should even be asking here?

  1. What version of Julia are you running?
  2. For β‰₯ 1.5, are you able to connect to pkg.julialang.org?
1 Like

Julia 1.5.1

I am intermittently capable of connecting to pkg.julialang.org’s hosting subdomains.

[root@b8739e480d50 ~]# wget pkg.julialang.org/registries
--2020-10-08 19:19:33--  http://pkg.julialang.org/registries
Resolving pkg.julialang.org (pkg.julialang.org)... 151.101.66.217, 151.101.130.217, 151.101.194.217, ...
Connecting to pkg.julialang.org (pkg.julialang.org)|151.101.66.217|:80... connected.
HTTP request sent, awaiting response... 301 NA (east2) internal redirect trigger
Location: https://us-east2.pkg.julialang.org/registries [following]
--2020-10-08 19:19:33--  https://us-east2.pkg.julialang.org/registries
Resolving us-east2.pkg.julialang.org (us-east2.pkg.julialang.org)... 18.212.158.78
Connecting to us-east2.pkg.julialang.org (us-east2.pkg.julialang.org)|18.212.158.78|:443... connected.
Unable to establish SSL connection.

I can ping pkg.julialang.org without problem.

Should I be setting something to trigger the β€œuse only libgit2” path here?

You can do export JULIA_PKG_SERVER=β€œβ€ to avoid using the package server but that may not be better depending on the situation.

1 Like

It was way faster. Thanks!

In terms of profiling, I instantiated my project in ~2.5 minutes after export JULIA_PKG_SERVER="", while it was taking me 30-60 minutes without it.