New Artifact System, Data, and OneDrive

General Usage
7

Thanks for the mention of DataDeps, I was not aware of it.

From what I can tell I see some differences (at least in the design idea?). Please feel free to correct me if I am wrong:

  • DataDeps can be used in the REPL, artifacts have to be part of a module.
  • Artifacts are garbage collected, so once a given artifact is not references anywhere anymore, it gets automatically removed after 30 days (or less if so configured)
  • In terms of difficulty, artifacts seem significantly harder to set up, but that might be just be inexperience.

I think for my use-case, DataDeps is more appropriate right now. However, the question of secure storage/access is still a problem.

  • I suppose one could take onedrive-sdk-python, write a PyCall.jl wrapper around it, and create a nice API and extend the relevant methods in Pkg.artifact and/or DataDeps. (Probably alot of effort)
  • Alternatively, use a different Cloud Storage provider. Does anyone know a service that is nicely accessible, perhaps via SSH keys?