Hi, I am trying to speed-up compilation of packages, PackageCompiler works nice, but current version uses all statements from package’s runtests.jl for creating precompiles. I think compiling only functions that I frequently use could speed-up sysimg creating.
I tried SnoopCompile but I only successfully generated precompiles file, also it was stated (https://github.com/JuliaLang/julia/issues/28557) that https://pkg.julialang.org/docs/julia/THl1k/1.1.1/devdocs/sysimg.html is obsolete.
I found https://github.com/TsurHerman/Fezzik, that seems to fit my use case.
PackageCompiler compiles Blink#master, but trying to compile using Fezzik throws:
_ _ _(_)_ | Documentation: https://docs.julialang.org
(_) | (_) (_) |
_ _ _| |_ __ _ | Type "?" for help, "]?" for Pkg help.
| | | | | | |/ _` | |
| | |_| | | | (_| | | Version 1.1.1 (2019-05-16)
_/ |\__'_|_|_|\__'_| | Official https://julialang.org/ release
|__/ |
julia> using Blink;
julia> w = Window()
Window(1, Electron(Process(`/home/kest/.julia/packages/Blink/1mBxc/deps/atom/electron /home/kest/.julia/packages/Blink/1mBxc/src/AtomShell/main.js port 8140`, ProcessRunning), Sockets.TCPSocket(RawFD(0x00000015) active, 0 bytes waiting), Dict{String,Any}("callback"=>##1#2())), Page(1, WebSocket(server, CONNECTED), Dict{String,Any}("callback"=>##1#2()), Distributed.Future(1, 1, 1, Some(true))))
julia> Fezzik.brute_build_julia()
[ Info: generating precompile
[Mux] already loaded
[WebSockets] already loaded
[Mustache] already loaded
[Lazy] already loaded
[Distributed] already loaded
[Pidfile] already loaded
[MacroTools] already loaded
[REPL] already loaded
[AssetRegistry] already loaded
[HTTP] already loaded
[JSON] already loaded
[Sockets] already loaded
[Base64] already loaded
[Blink] already loaded
[AbstractPlotting] already loaded
[Logging] already loaded
[Base] already loaded
[DocStringExtensions] already loaded
[JSExpr] already loaded
[Fezzik] already loaded
[Core] already loaded
[ Info: activating new environment at ~/.julia/packages/PackageCompiler/CJQcs/packages/Project.toml.
failed_packages = Symbol[]
[ Info: used 391 precompile statements
out_file = "/home/kest/.julia/packages/Fezzik/qjuGL/precomp.jl"
Compiling...
using Mux
Resolving package versions...
Updating `~/.julia/environments/v1.1/Project.toml`
[a975b10e] + Mux v0.7.0
Updating `~/.julia/environments/v1.1/Manifest.toml`
[no changes]
[WebSockets] already loaded
using Mustache
Resolving package versions...
Updating `~/.julia/environments/v1.1/Project.toml`
[ffc61752] + Mustache v0.5.12
Updating `~/.julia/environments/v1.1/Manifest.toml`
[no changes]
[Lazy] already loaded
[Distributed] already loaded
[Pidfile] already loaded
[MacroTools] already loaded
[REPL] already loaded
[AssetRegistry] already loaded
[HTTP] already loaded
[JSON] already loaded
[Sockets] already loaded
[Base64] already loaded
using Blink
[AbstractPlotting] already loaded
[Logging] already loaded
[Base] already loaded
[DocStringExtensions] already loaded
[JSExpr] already loaded
[Fezzik] already loaded
[Core] already loaded
signal (11): Segmentation fault
in expression starting at no file:0
jl_compile_linfo at /buildworker/worker/package_linux64/build/src/codegen.cpp:1176
emit_invoke at /buildworker/worker/package_linux64/build/src/codegen.cpp:3145
emit_expr at /buildworker/worker/package_linux64/build/src/codegen.cpp:3948
emit_ssaval_assign at /buildworker/worker/package_linux64/build/src/codegen.cpp:3662
emit_function at /buildworker/worker/package_linux64/build/src/codegen.cpp:3854
jl_compile_linfo at /buildworker/worker/package_linux64/build/src/codegen.cpp:1144
emit_invoke at /buildworker/worker/package_linux64/build/src/codegen.cpp:3145
emit_expr at /buildworker/worker/package_linux64/build/src/codegen.cpp:3948
emit_ssaval_assign at /buildworker/worker/package_linux64/build/src/codegen.cpp:3662
emit_function at /buildworker/worker/package_linux64/build/src/codegen.cpp:3854
jl_compile_linfo at /buildworker/worker/package_linux64/build/src/codegen.cpp:1144
jl_compile_hint at /buildworker/worker/package_linux64/build/src/gf.c:1949
jl_compile_specializations at /buildworker/worker/package_linux64/build/src/precompile.c:378 [inlined]
jl_precompile at /buildworker/worker/package_linux64/build/src/precompile.c:387 [inlined]
jl_write_compiler_output at /buildworker/worker/package_linux64/build/src/precompile.c:34
jl_atexit_hook at /buildworker/worker/package_linux64/build/src/init.c:222
main at /buildworker/worker/package_linux64/build/ui/repl.c:218
__libc_start_main at /usr/lib/libc.so.6 (unknown line)
_start at /home/kest/Downloads/julia-1.1.1/bin/julia (unknown line)
Allocations: 88711673 (Pool: 88682253; Big: 29420); GC: 205
ERROR: failed process: Process(`/home/kest/Downloads/julia-1.1.1/bin/julia --optimize=3 --output-o=/home/kest/.julia/packages/PackageCompiler/CJQcs/sysimg/sys.a -g1 --track-allocation=none --startup-file=no --code-coverage=none --history-file=yes --inline=yes --math-mode=ieee --handle-signals=yes --warn-overwrite=no --compile=yes --depwarn=yes --cpu-target=native --track-allocation=none --sysimage-native-code=yes --sysimage=/home/kest/.julia/packages/PackageCompiler/CJQcs/sysimg/sys.so -g1 --compiled-modules=yes --optimize=2 /home/kest/.julia/packages/PackageCompiler/CJQcs/sysimg/run_julia_code.jl`, ProcessSignaled(11)) [0]
Stacktrace:
[1] error(::String, ::Base.Process, ::String, ::Int64, ::String) at ./error.jl:42
[2] pipeline_error at ./process.jl:785 [inlined]
[3] #run#515(::Bool, ::Function, ::Cmd) at ./process.jl:726
[4] run at ./process.jl:724 [inlined]
[5] #run_julia#1 at /home/kest/.julia/packages/PackageCompiler/CJQcs/src/compiler_flags.jl:225 [inlined]
[6] #run_julia at ./none:0 [inlined]
[7] #compile_incremental#62(::Bool, ::Bool, ::Bool, ::Nothing, ::Function, ::Nothing, ::String) at /home/kest/.julia/packages/PackageCompiler/CJQcs/src/incremental.jl:137
[8] #compile_incremental at ./none:0 [inlined]
[9] #brute_build_julia#5(::Bool, ::Function) at /home/kest/.julia/packages/Fezzik/qjuGL/src/bootstrap.jl:184
[10] brute_build_julia() at /home/kest/.julia/packages/Fezzik/qjuGL/src/bootstrap.jl:78
[11] top-level scope at none:0
I filled issue here https://github.com/TsurHerman/Fezzik/issues/3
Perhaps somebody could comment on that?