The leadership team at Suzhou-Tongyuan has confirmed that we can provide an offline license checker and a standalone installation of the AOT compiler, independent of the full Syslab package, if there is potential for future commercial cooperation. (EDIT: ) You might see this post for more details: S…

How well does this compiler cooperate with Lux.jl? Is it practical to generate the inference code for Lux Models? Do you have any experience with this use case?

@liuyxpp How type-stable is the code? If the code is totally type-stable, things should mostly work. However, strict type stability is hard and we only see this property in lower-level packages such as DataStructures.jl, StaticArrays.jl and so on. I’ll have a try for Lux.jl on Monday. Do you have an…

Will it work with LoopVectorization.jl ? Does it generate and links to BLAS / LAPACK? If so, will it work with FastLapackInterface.jl ? The code is purely based on basic arrays of primitive types (Intxx, Uintxx, Floatxx).

[image] RoyiAvital: Will it work with LoopVectorization.jl ? llvmcall is not supported according to this announcement: [image] SyslabCC: Suzhou-Tongyuan's proprietary Julia AOT compiler is now available for free use (personal & educational license only) several special language constructs …

Lux.jl/test/enzyme_tests.jl at ca23485e6e50c8b4f4ae7aa6ac76fcf92b040195 · LuxDL/Lux.jl · GitHub would be nice to try out. These already work with Enzyme which requires a relatively high degree of type stability.

FYI Enzyme actually presently works fairly well with type unstable code. There’s still a few todos, but generally things work. I haven’t checked that recently but if memory serves those tests did require type unstable support.

We have recently uploaded the GH repo ( github.com/Suzhou-Tongyuan/JuliaCon2024-JuliaAOT ) holding the examples for the talk. See the folder features/compile-time, the recent version of SyslabCC would work with Flux CPU inference mode. The example trains the model at compile-time with Flux.jl & CUDA…

I tried exporting Lux’s model inference to C++/standalone executable with SyslabCC, but didn’t get a good luck. [image] It seems that LuxCore.apply is not type-stable, maybe mainly due to Statistics.mean’s type-unstability for high dimensional cases. Things like Base.sum(sequence; dims) or Stati…

[image] thautwarm: It seems that LuxCore.apply is not type-stable, maybe mainly due to Statistics.mean’s type-unstability for high dimensional cases. That seems to hit the training=Val(true) dispatches for normalization. You might have missed adding a testmode call LuxCore | Lux.jl Docs befor…

Trial of a Commercial Julia AOT Compiler with Offline License Checking

Tooling

Elrod June 1, 2024, 2:40pm 6

llvmcall is not supported according to this announcement:

Topic		Replies	Views
SyslabCC: Suzhou-Tongyuan's proprietary Julia AOT compiler is now available for free use (personal & educational license only) Community announcement , aot , staticcompiler	42	9287	October 21, 2024
Ahead-Of-Time (AOT) Compiler General Usage	6	5461	September 9, 2020
Julia using AOT compiler? General Usage question	5	3853	November 22, 2017
Why does the speed of Julia in AOT compilation differ from UX4? Performance performance , compilation , benchmark	12	802	September 21, 2024
Suggestion: introduce something like a @inferable or @typestable macro to the language Internals & Design	30	1608	August 21, 2022

Trial of a Commercial Julia AOT Compiler with Offline License Checking

Related topics