# Creating a custom Julia AWS Layer Runtime

**URL:** <https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166>\
**Category:** General Usage\
**Created:** [November 30, 2018, 12:03am UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166 "2018-11-30T00:03:24Z")\
**Posts on this page:** 10\
**Page:** 2

<div class="post-metadata">

**Author:** ![haydenfree](https://avatars.discourse-cdn.com/v4/letter/h/d9b06d/32.png) [@haydenfree](https://discourse.julialang.org/u/haydenfree)\
**Post date:** [June 11, 2019, 5:47pm UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/21 "2019-06-11T17:47:32Z")

</div>

Did you have any success trying to get this to work? From what I understand it seems like it works, but you aren’t able to import packages?

---

<div class="post-metadata">

**Author:** ![ianfiske](https://avatars.discourse-cdn.com/v4/letter/i/58f4c7/32.png) [@ianfiske](https://discourse.julialang.org/u/ianfiske)\
**Post date:** [June 11, 2019, 7:08pm UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/22 "2019-06-11T19:08:03Z")

</div>

Nope, I was trying to complete this in a 1-day hackathon and was unsuccessful. The final blocker was that I couldn’t get the size of the entire bundle within the aws limits. From [Lambda quotas - AWS Lambda](https://docs.aws.amazon.com/lambda/latest/dg/limits.html), the constraining limit was the size of the unzipped deployment package (250 MB).

---

<div class="post-metadata">

**Author:** ![abe](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/abe/32/8911_2.png) [@abe](https://discourse.julialang.org/u/abe)\
**Post date:** [July 5, 2019, 3:23pm UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/23 "2019-07-05T15:23:34Z")

</div>

Just wandered across this thread and I’m curious: has anyone has nailed down Julia on AWS Lambda? I’ve found a variety of older repos, but very little documentation on how to make it work. Can someone point me to a newer repo and documentation? I’d much appreciate the assist!

---

<div class="post-metadata">

**Author:** ![johnh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/johnh/32/3615_2.png) [@johnh](https://discourse.julialang.org/u/johnh)\
**Post date:** [July 13, 2019, 7:16am UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/24 "2019-07-13T07:16:00Z")

</div>

Hi @abe I just saw your comment. Also replying to @ianfiske  
We discussed this at the Cambridge Julia Meetup - indeed the AWS limits on size seem to be a blocker.  
This is a shame - however I imagine that there are sound reasons for the size limits, as lammdas are supposed to execute quickly and be set up/torn down easily.

I would like to explore this further though. We recently saw a Top500 supercomputer entry from [https://www.descarteslabs.com/](https://www.descarteslabs.com/) on AWS.  
One of the problems with setting up large distributed computations there is the set up time - I believe they used a pre-configured VM instance.  
Speaking very loosely, lambdas are meant to perform functions. It would be great to see Julia being able to run distributed functions using lambdas rather than setting up VMs.  
I guess we need to pay attention to

a) the ahead of time compilation of packages - yes I know there is PackageCompiler.jl  
There was also a package described on here recently which approached this problem.  
I forget what it was - can anyone remind me?

b) do Distributed Arrays work in this configuration

---

<div class="post-metadata">

**Author:** ![daniel](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/daniel/32/6480_2.png) [@daniel](https://discourse.julialang.org/u/daniel)\
**Post date:** [July 14, 2019, 12:06am UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/25 "2019-07-14T00:06:11Z")

</div>

> There was also a package described on here recently which approached this problem.  
> I forget what it was - can anyone remind me?

Probably [Fezzik.jl](https://github.com/TsurHerman/Fezzik)

---

<div class="post-metadata">

**Author:** ![johnh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/johnh/32/3615_2.png) [@johnh](https://discourse.julialang.org/u/johnh)\
**Post date:** [July 16, 2019, 7:07am UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/26 "2019-07-16T07:07:27Z")

</div>

Over on Openstack, I had not heard of Qinling which is Function As A Service for Openstack.

> **[A quickstart guide to deploying Qinling in production - Superuser](https://superuser.openinfra.dev/articles/how-to-deploy-qinling-in-production/)**
>
> Gaëtan Trellu, technical operations manager at Ormuco, offers this guide.

I am not sure if this offers any advantages for Julia, but might be interesting.

---

<div class="post-metadata">

**Author:** ![xiaodai](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/xiaodai/32/15937_2.png) [@xiaodai](https://discourse.julialang.org/u/xiaodai)\
**Post date:** [August 24, 2020, 1:15pm UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/27 "2020-08-24T13:15:04Z")

</div>

Sorry for necro-posting, but I dont see why I would want to start a new thread. Has anyone successful made anything in this area? This should be even easier now with `PackageCompiler.create_app`

---

<div class="post-metadata">

**Author:** ![ianfiske](https://avatars.discourse-cdn.com/v4/letter/i/58f4c7/32.png) [@ianfiske](https://discourse.julialang.org/u/ianfiske)\
**Post date:** [April 19, 2021, 6:39pm UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/28 "2021-04-19T18:39:36Z")

</div>

Just to update here, looks like this is now possible (see [[ANN] AWS Lambda Julia runtime](https://discourse.julialang.org/t/ann-aws-lambda-julia-runtime/59023) and [Running AWS Lambda functions with Julia | Tom Kwong - YouTube](https://www.youtube.com/watch?v=6DvpneWRb_w))

---

<div class="post-metadata">

**Author:** ![harris-chris](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/harris-chris/32/23877_2.png) [@harris-chris](https://discourse.julialang.org/u/harris-chris)\
**Post date:** [April 19, 2021, 10:08pm UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/29 "2021-04-19T22:08:00Z")

</div>

This is something I have been trying to use at my work, and I’ve created a package to simplify the process of creating the Lambda-compatible container and then pushing it to Lambda: [GitHub - harris-chris/Jot](https://github.com/harris-chris/julia-for-aws-lambda)  
Overall Julia seems to work well here - one remaining problem is that if the container is cold-started (ie, if the function has not been called for a while) then there is about a 2s delay while it gets going, vs a ~10ms delay if warm-started. This can theoretically be eliminated by PackageCompiler.jl and I’m trying to incorporate that at the moment.

---

<div class="post-metadata">

**Author:** ![yakir12](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/yakir12/32/297_2.png) [@yakir12](https://discourse.julialang.org/u/yakir12)\
**Post date:** [April 20, 2021, 7:36am UTC](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166/30 "2021-04-20T07:36:44Z")

</div>

Very cool!

[Previous page](https://discourse.julialang.org/t/creating-a-custom-julia-aws-layer-runtime/18166.md?page=1)
