Downloads.download or run(`wget`) much slower than direct `wget`

General Usage Performance
, ,
1

I am trying to download a relativelly large dataset from Zenodo (6GB), and if I use Downloads.download or run(wget) in a Julia v1.12 session, it takes 2h, while if I directly use wget in a console it takes 16 minutes.

Is there a parameter that limits the download speed and can be changed ?

2 Likes
2

Downloads.download uses libcurl — can you try downloading at the command line with curl instead of wget?

3

Probably aria2 is among the fastest. Julia binnary available here. Be gentle with servers, avoid getting banned, and enjoy lightning-fast download speeds. :- )