A problem of loading a CSV file: realloc(): invalid pointer

I installed the current stable release of Julia v1.9.2 into my machine three days ago. Since then, I’ve been facing a problem of loading a csv file (the file size: 217.8 MB). Jupyter notebook keeps telling me that a kernel is dead without any further error message, when I tried to load it. So, I went into REPL which gave me the following output:

julia> using Pkg, CSV, DataFrames, BenchmarkTools

julia> const jd=DataFrames;

julia> @benchmark data=CSV.read("DS_data.csv", jd.DataFrame)
realloc(): invalid pointer

[75853] signal (6.-6): Aborted
in expression starting at REPL[4]:1
pthread_kill at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
raise at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
abort at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
unknown function (ip: 0x7f25b70896f5)
unknown function (ip: 0x7f25b70a0d7b)
realloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
__gmpz_realloc at /opt/julia-1.9.2/bin/../lib/julia/libgmp.so.10 (unknown line)
__gmpz_import at /opt/julia-1.9.2/bin/../lib/julia/libgmp.so.10 (unknown line)
_widen at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:13 [inlined]
_scale at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:471 [inlined]
_scale at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:457 [inlined]
scale at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:418 [inlined]
parseexp at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:368 [inlined]
parsefrac at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:333 [inlined]
parsedigits at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:251 [inlined]
typeparser at /home/administrator/.julia/packages/Parsers/Vdwny/src/floats.jl:171 [inlined]
xparse at /home/administrator/.julia/packages/Parsers/Vdwny/src/Parsers.jl:254 [inlined]
parsevalue! at /home/administrator/.julia/packages/CSV/Zl2ww/src/file.jl:916
parserow at /home/administrator/.julia/packages/CSV/Zl2ww/src/file.jl:662 [inlined]
parsefilechunk! at /home/administrator/.julia/packages/CSV/Zl2ww/src/file.jl:550
unknown function (ip: 0x7f259e544c2b)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
#File#25 at /home/administrator/.julia/packages/CSV/Zl2ww/src/file.jl:309
File at /home/administrator/.julia/packages/CSV/Zl2ww/src/file.jl:227
unknown function (ip: 0x7f259e50cc3d)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
#File#24 at /home/administrator/.julia/packages/CSV/Zl2ww/src/file.jl:224
File at /home/administrator/.julia/packages/CSV/Zl2ww/src/file.jl:182
#read#81 at /home/administrator/.julia/packages/CSV/Zl2ww/src/CSV.jl:45
read at /home/administrator/.julia/packages/CSV/Zl2ww/src/CSV.jl:41 [inlined]
##core#293 at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:489
##sample#294 at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:495
unknown function (ip: 0x7f259e5068a4)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
#_run#48 at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:99
_run at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:92
unknown function (ip: 0x7f259e50621d)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
jl_apply at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/julia.h:1879 [inlined]
jl_f__call_latest at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/builtins.c:774
#invokelatest#2 at ./essentials.jl:818 [inlined]
invokelatest at ./essentials.jl:813 [inlined]
#run_result#45 at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:34 [inlined]
run_result at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:34 [inlined]
#run#49 at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:117
run at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:117 [inlined]
run at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:117 [inlined]
#warmup#54 at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:169 [inlined]
warmup at /home/administrator/.julia/packages/BenchmarkTools/0owsb/src/execution.jl:168
unknown function (ip: 0x7f259e5059c2)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
jl_apply at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/julia.h:1879 [inlined]
do_call at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/interpreter.c:126
eval_value at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/interpreter.c:226
eval_stmt_value at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/interpreter.c:177 [inlined]
eval_body at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/interpreter.c:624
jl_interpret_toplevel_thunk at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/interpreter.c:762
jl_toplevel_eval_flex at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/toplevel.c:912
jl_toplevel_eval_flex at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/toplevel.c:856
ijl_toplevel_eval_in at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/toplevel.c:971
eval at ./boot.jl:370 [inlined]
eval_user_input at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/usr/share/julia/stdlib/v1.9/REPL/src/REPL.jl:153
repl_backend_loop at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/usr/share/julia/stdlib/v1.9/REPL/src/REPL.jl:249
#start_repl_backend#46 at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/usr/share/julia/stdlib/v1.9/REPL/src/REPL.jl:234
start_repl_backend at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/usr/share/julia/stdlib/v1.9/REPL/src/REPL.jl:231
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
#run_repl#59 at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/usr/share/julia/stdlib/v1.9/REPL/src/REPL.jl:379
run_repl at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/usr/share/julia/stdlib/v1.9/REPL/src/REPL.jl:365
jfptr_run_repl_59978.clone_1 at /opt/julia-1.9.2/lib/julia/sys.so (unknown line)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
#1017 at ./client.jl:421
jfptr_YY.1017_37237.clone_1 at /opt/julia-1.9.2/lib/julia/sys.so (unknown line)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
jl_apply at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/julia.h:1879 [inlined]
jl_f__call_latest at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/builtins.c:774
#invokelatest#2 at ./essentials.jl:816 [inlined]
invokelatest at ./essentials.jl:813 [inlined]
run_main_repl at ./client.jl:405
exec_options at ./client.jl:322
_start at ./client.jl:522
jfptr__start_43375.clone_1 at /opt/julia-1.9.2/lib/julia/sys.so (unknown line)
_jl_invoke at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2758 [inlined]
ijl_apply_generic at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/gf.c:2940
jl_apply at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/julia.h:1879 [inlined]
true_main at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/jlapi.c:573
jl_repl_entrypoint at /cache/build/default-amdci5-2/julialang/julia-release-1-dot-9/src/jlapi.c:717
main at julia (unknown line)
unknown function (ip: 0x7f25b7029d8f)
__libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
unknown function (ip: 0x401098)
Allocations: 9391543 (Pool: 9382786; Big: 8757); GC: 15
Aborted (core dumped)

The information of my machine (Ubuntu 22.04) is:

julia> versioninfo()
Julia Version 1.9.2
Commit e4ee485e909 (2023-07-05 09:39 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
  CPU: 8 × Intel(R) Core(TM) i7-10510U CPU @ 1.80GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-14.0.6 (ORCJIT, skylake)
  Threads: 1 on 8 virtual cores

I highly appreciate it if the community could provide me with any way out of it (Please note: Neither am I a professional programmer nor a computer scientist).

PS: Using the other machine, I reverted back to LTS version (v1.6.7), which does not produce any error. v1.6.7 is working perfectly fine.

This is a bummer. What version of CSV.jl are you using? Maybe rather than downgrade to Julia LTS, you should downgrade to a more stable version of CSV.jl.

@pdeffebach: Thank you very much for your suggestion! BTW, the version of CSV.jl is v0.8.5 which is not the latest version (= v0.10.11). REPL tells me that, due to the compatibility constraints, CSV.jl and some other packages are not upgraded. Given the circumstances, should I downgrade this package further (I suspect that you would say NO.) or any further suggestion? Many thanks in advance!

Dear Peter (@pdeffebach),

I partially followed your suggestion by (i) removing Stan.jl (I do not know whether this decision was correct) and (ii) updating Julia packages. After this, CSV.jl was upgraded to the latest version and the problem is completely gone! Everything is working smoothly now. Your post gave me the best clue to solve the issue. Thank you very much again!