I am translating about 6k lines of R to Julia for the sake of speed and everything has been faster, significantly faster in Julia except for this specific task. I suspect what I have done below may not be the right way to apply this logic because this specific logic is easily 10-12 times faster than…

Can you please report the timing of: function f(Gdf, search_space) sss = Set(search_space) [all(x -> in(x, sss), group.col_two) for group in Gdf] end @time condition = f(Gdf, search_space) @time Gdf[condition] as on your data it is hard to benchmark since it is too small (I need to unders…

How to efficiently apply user-defined functions against grouped dataframes in `DataFrames.jl`?

New to Julia

nilshg February 9, 2024, 5:50am 2

Have you tried making search_space a Set?

2 Likes

Topic		Replies	Views
DataFramesMeta custom filter: by groups of A, apply filter on B Data	4	1438	May 27, 2019
Filter doesn't work on grouped dataframe General Usage dataframes	5	1585	February 4, 2022
Is there a faster way to filter in dataframes New to Julia dataframes , namedtuple	9	1338	August 29, 2021
Applying group selection conditions using groupeddataframes New to Julia dataframes	21	2302	September 20, 2020
Group DataFrames by a function of a column Data package	4	1220	December 11, 2019

How to efficiently apply user-defined functions against grouped dataframes in `DataFrames.jl`?

Related topics