Snap Package for Linux distribution

Hi, so I have been using Julia for about 7-8 months now, and I have noticed that while there is a package for CentOS/RedHat/Fedora, I noticed that there is no longer an official julia apt package. Now, Ubuntu’s maker, Canonical, has been really pushing this new thing called Snaps. They are now universal across pretty much all the major Linux distributions. I was wondering if there was any talk about making an official Julia Snap package, then all Linux distro’s have a simple setup?

3 Likes

Yes, it’s been discussed recently here, but no work has been done so far. The main issue is that only recent distributions support Snap or Flatpak, so we will still need to provide generic binary tarballs anyway. But a contribution to support Snap would certainly be appreciated (either as a community-maintained effort or even maybe as an official download). It appears that a simple way of creating a package would be to simply re-bundle the binary tarballs without even rebuilding Julia.

I have been wary of snap for a while (yet another damn update mechanism), but I have been using it for 3 months now and it is really seamless. Once you authenticate, you no longer need to be root, and updating is really simple (snap refresh).

It is my impression that many FOSS projects that release more frequently than 3-6 months have decided that they need something in between tarballs (a bit too manual) and distro packages (high maintenance for all the distros out there) went with snap.

The only issue I can see for Julia is the confinement model; which restricts file system access to $HOME. But if I understand correctly, there is a classic mode which would get around this globally (but it requires manual review from the snap organization), and in any case, the user can override this so maybe this is not much of a hassle.

3 Likes

Update:

A snap called julia-stable (https://snapcraft.io/julia-stable) is available. It’s sourced from: https://git.fmind.me/fmind/snap-julia-stable and is just a dump of the official tar.gz file.
The problem is that it’s not up-to-date (=1.0.0) and doesn’t carry the “right” name i.e julia.

@mortenpi has a similar snap in his repo (GitHub - mortenpi/julia-snaps: Snap packages for Julia), which predates the above one but isn’t registered.

It would be really good if the Julia creators could take the existing snaps and turn them into an official snap with bells and whistles (integration into CI/release process, utilizing multiple channels (LTS vs most current), …).

3 Likes

I also think it would be good to have something like a snap, distribution agnostic and auto update from the repository. However, I would prefer flatpak. Snap is more of an Ubuntu thing that kinds of work in other distributions. But flatpak support is generally better in most distributions:

Even on Ubuntu, I have replaced most of snaps by flatpak version of the apps. On Fedora, I have no problems with Flatpak but snap support was not so good.

However, there are still some issues regarding how to expose command line applications in flatpak:

1 Like

I think the strict confinement model could actually be an advantage to a Julia snap for people concerned about all the issues discussed here: Pkg: attack vectors . Malicious packages might not be a major problem if Julia can’t see your home directory.

The major issue with Flatpak is the integration with Atom and VSCode, which currently can’t be got to work (see this issue and this thread). But that doesn’t prevent creating a Julia Flatpak which is usable from the commandline. Users have to create a symlink manually, which is inconvenient but not the end of the world either.

I had made a Flatpak for Julia 0.6. If somebody wants to update it to 1.1 and publish it to FlatHub that would be useful. Most/all of the work should be updating the versions of dependencies.

2 Likes

On most machines this would make Julia perfectly unusable, except for sending commands and receiving output via pipes.

I was enthusiastic about snap first, but I think that the installers/tarballs are now very convenient and impose much less of a maintenance burden (cf install-julia). I guess a snap/flatpak/etc package will be maintained when someone really wants to do it.

1 Like

I’ve looked through the available programming related snaps (languages and IDEs): most of them use classic confinement mode.

Snaps declaring their confinement as “classic”, have access to the rest of the system, as most legacy (debian packages for example) packaged apps do, while still benefiting from the ci-integrated store model, with automated updates, rollbacks to older versions, release channels, etc. (From https://blog.ubuntu.com/2017/01/09/how-to-snap-introducing-classic-confinement)

With this the connection to atom shouldn’t be a problem.

Being able to use a OS supported installation/rollback method instead of manual scripts sounds compelling to me.

With all the talk about Julia should be easy for beginners e.g. by shielding them from understanding scoping, I wonder why it is never a problem for teachers to require the shell, tar, symbolic links and environment variables like PATH until you can start Julia.

Julia is now a snap available in the snap store Install julia on Linux | Snap Store

Currently the LTS track seems to be available only (1.0.4) but perhaps other versions will become available. I just installed Julia snap on my openSUSE system and it works fantastically. Thank you for everyone who made this possible.

6 Likes

Yes, Alex Arslan (mostly) and I put that up last week. We are using “classic” confinement mode (so you can e.g. actually access files :slight_smile: ), which is what other languages seem to do. We eventually plan to provide “tracks” for different minor versions of julia, but snap wasn’t originally designed for programs with multiple user-selectable versions so doing that is not easy enough yet. I think it will get there though.

4 Likes

Are any updates planned for the snap package? It’s still on v1.0.4.

Related to Snap, I have no idea how the installation process works, but I found a few people that installed 32-bit version of Snap Julia on 64-bit systems, causing troubles with binary dependencies.

That snap release was published half a year after Julia 1.1 was available, so I assume that the publisher intended to provide the LTS version, not the latest stable version.

v1.0.4 is still one patch behind the latest LTS version, so it could be updated indeed, but depending on what version you expected, it is not that far away.

@ararslan mentioned on Slack that it’s not yet decided if they want to support snap further on, as it incurs some overhead.
I’d for one prefer snap over distributions trying to compile and build Julia on their own, so I’ve created a PR to update the snap to 1.0.5 (https://github.com/JuliaCI/julia-snap/pull/4).

Although the track request has already been posted a while ago: Request for Julia tracks: 1.0, 1.1, 1.2, 1.3 - store-requests - snapcraft.io I think it would be less work to only have two tracks (Channels | Snapcraft documentation): lts and latest.

1 Like

Recently moved to linux (Manjaro/Arch) and needed to decide between Snap, official binaries, pacman…
Noted the Snap wasn’t latest version, so went with pacman install which gave latest v1.2 Not sure if I would have had the Arpack build issues (described here Resolved: Arpack deps.jl Linux build issue) with Snap or binaries.
Another thing that is a bit confusing (or just new and something else to understand) is the appearance of all the “loops” in the form /dev/loopXXX in my mount list:

df -aTh | more 
Filesystem                     Type             Size  Used Avail Use% Mounted on
/dev/loop1                     squashfs          55M   55M     0 100% /var/lib/snapd/snap/core18/1223
/dev/loop0                     squashfs          43M   43M     0 100% /var/lib/snapd/snap/snap-store/201
/dev/loop3                     squashfs         147M  147M     0 100% /var/lib/snapd/snap/slack/18
/dev/loop5                     squashfs          55M   55M     0 100% /var/lib/snapd/snap/core18/1265
/dev/loop4                     squashfs          20M   20M     0 100% /var/lib/snapd/snap/node/2494
/dev/loop2                     squashfs          90M   90M     0 100% /var/lib/snapd/snap/core/7917
/dev/loop7                     squashfs         8.2M  8.2M     0 100% /var/lib/snapd/snap/evince/214
/dev/loop11                    squashfs          25M   25M     0 100% /var/lib/snapd/snap/heroku/3848
/dev/loop10                    squashfs          23M   23M     0 100% /var/lib/snapd/snap/snapd/4992
/dev/loop12                    squashfs          68M   68M     0 100% /var/lib/snapd/snap/sublime-text/77
/dev/loop13                    squashfs         145M  145M     0 100% /var/lib/snapd/snap/slack/19
...

If you are an Arch user, I assume that you are comfortable with the command line, so just git cloneing the repo and compiling the version you need is also an option.

2 Likes

Thanks for the input Tamas, appreciated. Haha, as comfortable as can be after 3wks, am wresting w/ keybinding conflict in ~/.zshrc atm to get command history search to work properly.

Have sort of been avoiding use of Snap/Snapstore (hence interest in this thread) and current process with Julia or any other package is:

  1. search if package is available via pacman using sudo pacman -Ss <packagename>; install if available; watch for dependencies, optional dependencies and install those as needed
  2. if git repo avail, git clone <gitlink> into specific pkgtmp directory, take a look at the PKGBUILD file, then makepkg -si.
  3. if above isn’t an option, try Yay and Pamac next.
  4. if those don’t pan out, download a tarball using wget, tar -xvzf <tarball>, and go from there.

Looking at notes, it seems snapd and snap were different and was guided in arch forums to use snapd if I recall, notes:

  154  $ sudo pacman -S snapd
  155  $ sudo systemctl enable --now snapd.socket
  156: Created symlink /etc/systemd/system/sockets.target.wants/snapd.socket → /usr/lib/systemd/system/snapd.socket.
  157  $ sudo ln -s /var/lib/snapd/snap /snap

In Ubuntu and Debian, my strategy is to use packaged solutions from the distribution repositories for 99% of software, and compile from source for the rest which is critical for me and has a rapid update cycle.

I think Julia is very well set up for just downloading/cloning the source, compiling it, and running from that directory without any “installation”. I find this much more convenient than any alternative.

3 Likes

For stable version of Julia on Arch Linux I use AUR (en) - julia-bin, which simply grabs the official Julia binary

1 Like