Lots of messages printed out when I evaluate the model using MLJ

Specific Domains Machine Learning
1

I see lots of messages printed out when I evaluate the model:

  • There are "error"s in the printed messeges. Are they really errors? how critical is it? or can I just ignore them? (The evaluation result looks fine though)
  • If they can be ignnored, how can I turn them off? vebosity=0 option doesn’t seem take effect.
using MLJ

X, y = @load_iris

LogisticClassifier = @load LogisticClassifier pkg=MLJLinearModels verbosity=0

lc = LogisticClassifier()

evaluate(lc, X, y,
        resampling=CV(shuffle=true),
        measures=[log_loss, accuracy],
        verbosity=0)



Internal error: encountered unexpected error in runtime:
ErrorException("unhandled Vararg")
error at .\error.jl:35
widenconst at .\compiler\typelattice.jl:342
unknown function (ip: 00000000a5aead76)
issimplertype at .\compiler\typelimits.jl:319
tmerge at .\compiler\typelimits.jl:362
abstract_apply at .\compiler\abstractinterpretation.jl:1304
abstract_call_known at .\compiler\abstractinterpretation.jl:1554
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2284
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call_known at .\compiler\abstractinterpretation.jl:1549 [inlined]
abstract_iteration at .\compiler\abstractinterpretation.jl:1143
precise_container_type at .\compiler\abstractinterpretation.jl:1131
abstract_apply at .\compiler\abstractinterpretation.jl:1248
abstract_call_known at .\compiler\abstractinterpretation.jl:1554
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2284
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2284
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call at .\compiler\abstractinterpretation.jl:1722
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2284
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call at .\compiler\abstractinterpretation.jl:1722
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:151
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2310
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_edge at .\compiler\typeinfer.jl:876
abstract_call_method at .\compiler\abstractinterpretation.jl:632
abstract_call_gf_by_type at .\compiler\abstractinterpretation.jl:156
abstract_call_known at .\compiler\abstractinterpretation.jl:1666
abstract_call at .\compiler\abstractinterpretation.jl:1724
abstract_call at .\compiler\abstractinterpretation.jl:1703
abstract_eval_statement at .\compiler\abstractinterpretation.jl:1845
typeinf_local at .\compiler\abstractinterpretation.jl:2284
typeinf_nocycle at .\compiler\abstractinterpretation.jl:2406
_typeinf at .\compiler\typeinfer.jl:230
typeinf at .\compiler\typeinfer.jl:213
typeinf_ext at .\compiler\typeinfer.jl:957
typeinf_ext_toplevel at .\compiler\typeinfer.jl:990
typeinf_ext_toplevel at .\compiler\typeinfer.jl:986
jfptr_typeinf_ext_toplevel_15844.clone_1 at D:\Programs\julia-1.8.0-beta3\lib\julia\sys.dll (unknown line)
_jl_invoke at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2358 [inlined]
ijl_apply_generic at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2540 [inlined]
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
jl_type_infer at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:319
jl_generate_fptr_impl at /cygdrive/c/buildbot/worker/package_win64/build/src\jitlayers.cpp:314
jl_compile_method_internal at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2072
jl_compile_method_internal at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2019 [inlined]
_jl_invoke at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2350 [inlined]
ijl_apply_generic at /cygdrive/c/buildbot/worker/package_win64/build/src\gf.c:2540
evaluate! at E:\.julia\packages\MLJBase\rMXo2\src\resampling.jl:1190
unknown function (ip: 00000000a5aea000)
evaluate! at E:\.julia\packages\MLJBase\rMXo2\src\resampling.jl:1261
unknown function (ip: 00000000a5ae4ee7)
#evaluate!#276 at E:\.julia\packages\MLJBase\rMXo2\src\resampling.jl:948
evaluate!##kw at E:\.julia\packages\MLJBase\rMXo2\src\resampling.jl:913
unknown function (ip: 00000000a5ae2b54)
#evaluate#277 at E:\.julia\packages\MLJBase\rMXo2\src\resampling.jl:961
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
do_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\builtins.c:725
evaluate##kw at E:\.julia\packages\MLJBase\rMXo2\src\resampling.jl:961
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
do_call at /cygdrive/c/buildbot/worker/package_win64/build/src\interpreter.c:126
eval_value at /cygdrive/c/buildbot/worker/package_win64/build/src\interpreter.c:215
eval_stmt_value at /cygdrive/c/buildbot/worker/package_win64/build/src\interpreter.c:166 [inlined]
eval_body at /cygdrive/c/buildbot/worker/package_win64/build/src\interpreter.c:594
jl_interpret_toplevel_thunk at /cygdrive/c/buildbot/worker/package_win64/build/src\interpreter.c:750
top-level scope at In[37]:9
jl_toplevel_eval_flex at /cygdrive/c/buildbot/worker/package_win64/build/src\toplevel.c:906
jl_toplevel_eval_flex at /cygdrive/c/buildbot/worker/package_win64/build/src\toplevel.c:850
ijl_toplevel_eval at /cygdrive/c/buildbot/worker/package_win64/build/src\toplevel.c:915 [inlined]
ijl_toplevel_eval_in at /cygdrive/c/buildbot/worker/package_win64/build/src\toplevel.c:965
eval at .\boot.jl:368 [inlined]
include_string at .\loading.jl:1277
softscope_include_string at E:\.julia\packages\SoftGlobalScope\u4UzH\src\SoftGlobalScope.jl:65
execute_request at E:\.julia\packages\IJulia\AQu2H\src\execute_request.jl:67
unknown function (ip: 00000000b9f7066a)
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
jl_f__call_latest at /cygdrive/c/buildbot/worker/package_win64/build/src\builtins.c:769
#invokelatest#2 at .\essentials.jl:729 [inlined]
invokelatest at .\essentials.jl:727 [inlined]
eventloop at E:\.julia\packages\IJulia\AQu2H\src\eventloop.jl:8
#15 at .\task.jl:482
unknown function (ip: 000000005d1ff2a3)
jl_apply at /cygdrive/c/buildbot/worker/package_win64/build/src\julia.h:1831 [inlined]
start_task at /cygdrive/c/buildbot/worker/package_win64/build/src\task.c:931


PerformanceEvaluation object with these fields:
  measure, measurement, operation, per_fold,
  per_observation, fitted_params_per_fold,
  report_per_fold, train_test_pairs
Extract:
┌────────────────────────────┬─────────────┬──────────────┬─────────────────────
│ measure                    │ measurement │ operation    │ per_fold           ⋯
├────────────────────────────┼─────────────┼──────────────┼─────────────────────
│ LogLoss(tol = 2.22045e-16) │ 0.689       │ predict      │ [0.777, 0.699, 0.6 ⋯
│ Accuracy()                 │ 0.873       │ predict_mode │ [0.76, 0.88, 0.92, ⋯
└────────────────────────────┴─────────────┴──────────────┴─────────────────────
2

Here are the results of a run on my system with Julia (nightly)

PerformanceEvaluation object with these fields:
  measure, measurement, operation, per_fold,
  per_observation, fitted_params_per_fold,
  report_per_fold, train_test_pairs
Extract:
┌────────────────────────────┬─────────────┬──────────────┬────────────────────────────────────────────┐
│ measure                    │ measurement │ operation    │ per_fold                                   │
├────────────────────────────┼─────────────┼──────────────┼────────────────────────────────────────────┤
│ LogLoss(tol = 2.22045e-16) │ 0.69        │ predict      │ [0.699, 0.679, 0.703, 0.732, 0.684, 0.646] │
│ Accuracy()                 │ 0.847       │ predict_mode │ [0.92, 0.88, 0.84, 0.84, 0.72, 0.88]       │
└────────────────────────────┴─────────────┴──────────────┴────────────────────────────────────────────┘

The messages you are seeing indicate internal compiler errors (and normally that is pretty serious). I’d suspect problems with your setup (Julia version/Package versions).

1 Like
3

Thank you for checking! Indeed The error occurs with Julia 1.8.0-beta3 but not with Julia 1.7.2.

4

You testing -beta3 indicates you are going to report it? Thanks!

5

Yes I am!

1 Like
6

Retesting with a nightly nightly I see:

[ Info: Precompiling MLJLinearModels [6ee0df7b-362f-4a72-a706-9e79364fb692]
Internal error: encountered unexpected error in runtime:
ErrorException("unhandled Vararg")
error at .\error.jl:35
widenconst at .\compiler\typelattice.jl:342

So this a recent regression spilling into 1.8.0-beta3!