Roadmap for small binaries

[woclass]

A prototype of `pkgimage` binary cache system for reducing latency

This is a repost from the slack. Slack doesn’t work quite well for long articles, so I decide to repost it here. Recently we (Tongyuan) have investigated into binary compilation using LLVM’s new JIT linking architecture. In short, we have coded a prototype which can generate binary code from the test files of the packages individually and load them in a new session to remove latency. Contrasted to PackageCompiler, our prototype can now compile the package separately, where the compile time is l…