I am trying to use MLJ on a DataFrame (30,000 rows x 8,000 columns) but every table operation seems to take a huge amount of time to compile but is fast to run. I have given an example with code below in which a 5 x 5000 DataFrame is generated and it gets stuck on the unpack line (line 3). When I r…

Simple Table Operation Has Very Large Compilation Time with MLJ

pdeffebach June 9, 2022, 2:43pm 2

My guess is that it’s casting the DataFrame as a NamedTuple of vectors at some point. I took a glance but couldn’t find where that was happening.

1 Like

Topic		Replies	Views
CSV.jl's CSV write seems slow Performance	32	5709	January 28, 2020
Query.jl extremely slow General Usage	6	732	February 23, 2019
[ANN] RowTables.jl Data announcement	6	1105	July 26, 2018
The state of DataFrames.jl H2O benchmark Package Announcements dataframes	53	9227	January 1, 2025
Startup Speed New to Julia question	6	1867	March 15, 2022