Discontinuation of ParallelDataTransfer.jl?

General Usage
1

It seems to me that ParallelDataTransfer.jl is discontinued - the project still misses project.toml file and uses REQUIRE - this blocks the package from being installed in recent versions of Julia.

My question is - is there a successor or a replacement package for data transfer between workers? Or a workaround? I’d like to know before starting PRs to support ParallelDataTransfer.jl in my workflows on Julia 1.8.

2

I haven’t touched it in a long time, but is anything broken with it? It wouldn’t be too difficult to check. It’s a relatively simple package and only dependent on Base, so I’d be surprised if much needed to be changed. I’d assume it would take like half an hour to get the actions setup and get it back alive. If that’s done, I’d also move it from my personal account to SciML to get other maintainers on it.

Run the tests locally and see if it’s still running.

3

It looks like it’s working just fine:

(@v1.8) pkg> add ParallelDataTransfer
    Updating registry at `C:\Users\accou\.julia\registries\General`
    Updating git-repo `https://github.com/JuliaRegistries/General.git`
   Resolving package versions...
   Installed ParallelDataTransfer ─ v0.5.0
    Updating `C:\Users\accou\.julia\environments\v1.8\Project.toml`
  [2dcacdae] + ParallelDataTransfer v0.5.0
    Updating `C:\Users\accou\.julia\environments\v1.8\Manifest.toml`
  [2dcacdae] + ParallelDataTransfer v0.5.0
Precompiling project...
  2 dependencies successfully precompiled in 55 seconds. 391 already precompiled.

(@v1.8) pkg> test ParallelDataTransfer
     Testing ParallelDataTransfer
      Status `C:\Users\accou\AppData\Local\Temp\jl_BFxA0k\Project.toml`
  [2dcacdae] ParallelDataTransfer v0.5.0
  [8ba89e20] Distributed `@stdlib/Distributed`
  [9a3f8284] Random `@stdlib/Random`
  [8dfed614] Test `@stdlib/Test`
      Status `C:\Users\accou\AppData\Local\Temp\jl_BFxA0k\Manifest.toml`
  [2dcacdae] ParallelDataTransfer v0.5.0
  [2a0f44e3] Base64 `@stdlib/Base64`
  [8ba89e20] Distributed `@stdlib/Distributed`
  [b77e0a4c] InteractiveUtils `@stdlib/InteractiveUtils`
  [56ddb016] Logging `@stdlib/Logging`
  [d6f4376e] Markdown `@stdlib/Markdown`
  [9a3f8284] Random `@stdlib/Random`
  [ea8e919c] SHA v0.7.0 `@stdlib/SHA`
  [9e88b42a] Serialization `@stdlib/Serialization`
  [6462fe0b] Sockets `@stdlib/Sockets`
  [8dfed614] Test `@stdlib/Test`
     Testing Running tests...
     Testing ParallelDataTransfer tests passed

Could you please share what you ran into?

1 Like
4

Hi Chris,
sorry for the false-positive report. The problem I was facing was in my part of the code - I suspected the ParallelDataTransfer to be the root-cause, I tried to ]dev it and it failed in the dev-process as julia didn’t find the Project.toml. It looks like for the dev-clonning the package needs the Project.toml set-up. I’ll keep the issue open - I’ll hopefully find some time to do a Project.toml PR soon.

5

Update done.