Julia in production: examples and share your experience

I am looking for examples of Julia successfully implemented IN PRODUCTION. Can somebody point me at examples or share positive/negative experience with Julia in Prod.?

1 Like

Here are some high profile cases:

https://juliacomputing.com/case-studies/

There are many others.

3 Likes

I use Julia for my (data science) job and have a couple of Julia programs that are up “in production”.

Primarily my take on this is that, in 2019, everyone doing everything via “microservices” makes using Julia really not that much different than using anything else. Even the people at my company using Python are, for the most part, not directly making calls to other in-house Python libraries, but rather depending on IO. Therefore, using Julia isn’t really much different. This has been a god-send for me: where I work it’s nigh on impossible to get anyone to use Julia (though there are some cases, particularly where JuMP is involved, in which Julia is so comically superior to any available alternative that for the most part everyone has is forced to admit that Julia is the right choice). If it were not for the microservices world, my colleagues would make it almost impossible for me to use Julia (even though PyCall is excellent and JavaCall is working again in 1.3), but, as it is, nobody really cares. Just about every interaction a program does with the outside world is via HTTP or some SQL query, so as long as these things work, nobody can really object to my using Julia. (Also, probably nobody wants to hear me give a half hour speach about how terrible Python is if they try to get me to use it.)

In my experience so far, all of the above applies just as well to “production” as development. My Julia programs live in some docker image that runs somewhere. It fetches data, usually either through HTTP (thanks to AWS services it is almost always possible these days to get data through HTTP), or PostgreSQL. Testing is pretty much the same as it is with anything else; unit tests on the program itself can be run anywhere where the docker has access to input data, integration testing is free to treat the docker image as a black box, the same as if it were written in any other language. My one major concern down the line is my colleagues increasing use of Databricks, which looks to me like a proprietary horror show, however, I believe that even in the worst case scenarios I’ll always be able to get anything I need through a JDBC driver (which very unfortunately would add the JVM as a dependency to my programs, but it’s not the end of the world).

There is however, one huge black mark on the whole Julia usage narrative, particularly “in production”: difficulty of statically compiling binaries. This has been a thorn in my side since I’ve started using the language, and now that I have more stuff “in production” I feel it much more keenly. Particularly if I’m using a docker image, the most I can do before running my program is have the docker build script run using in Julia for all the critical packages. This at least generates the *.ji files, but very painfully, every single time the docker runs, everything has to get recompiled. This means there is an awful 30 to 180 s lag before anything in my docker image can run, even if it’s a simple utility. The only alternative right now is PackageCompiler, but this tends to be fiddly and difficult, so it’s only really worth it if you absolutely must run with low latency or if your code doesn’t change for a really long time (unfortunately in my case everything is under constant development).

So, in summary, the only special difficulty I find with using Julia in production is the difficulty of compiling static binaries. For the rest, it’s much like using anything else.

16 Likes

Fortunately, @kristoffer.carlsson is working on a successor to PackageCompiler for compiling Julia applications, so we can expect something that works more reliably at some point in the relatively near future (although I don’t want to make any promises about how long it will take).

34 Likes

:tada:

That’s the best Julia news I’ve heard since the 1.3 multi-threading anouncement. Even if it’s a ways off, just to know it’s getting taken seriously and being worked on in earnest is a huge comfort.

6 Likes

I was going to quote the scene from Pulp Fiction where Marsellus tells Jules he’s sending The Wolf to take care of the Marvin situation, but when I looked up the actual quote it’s… um, entirely inappropriate for this forum :joy:. But anyway, Kristoffer == Mr Wolf.

20 Likes

Sorry to deraul this thread further by continuing to talk about this (feel free to break it off), but I just wanted to correct something I said earlier that was a bit off point: true static binaries are not necessarily what I care about, the real issue is running code with no or drastically reduced latency, even if the binaries I need are still huge. Probably the simplest and most practical approach (considering my experience with PackageCompiler) would be to easily compile and swap out system images (PackageCompiler is certainly a step in this direction, at least). If we could do this, true static binaries would be an even more niche use case.

My fantasy is to have the standard base system image that everything shares and the ability to compile “system image modules” (or “extensions”) which can easily and conveniently be selected and tacked on. I’m not quite sure how technically feasible this is, but from a user perspective it would be pretty great. If I had this I’d probably spend very little time bemoaning the difficulty of compiling static binaries.

I created a few internal-facing tools for Intel in Julia, at least two of which are still in use. My current employer, Rigetti Computing, uses Julia extensively, and we’ve open sourced a few packages and also hosted Julia meetups in the past.

A few thoughts:

  • Custom registries in 1.1 was a huge step forward. There’s still a few annoyances like needing to ssh-add keys from within the Julia command mode, but overall it works great.
  • Precompilation times can discourage beginning users since it often is their first impressions of the language. I heard that 1.3 fixes a few issues related to this so hopefully that should help.
  • The language documentation is very helpful, but package-level documentation varies widely.
  • I’m also eagerly awaiting compilation for a few different projects.
6 Likes