I am trying to add a column to a df i already have populated, and on a smaller batch size it works just fine, example code below:
Timeddf = @linq dfData |> groupby(:ID) |> transform(Trailing12 = running(prod, (:Growth .+1), 12).-1)
using Dataframes & Rollingfunctions, so when the dfData is about 2000 rows, no issues, code executes and does what is expected, but when I add all of the IDs, dfData grows to about 100k rows, and the above code throws out an error:
nested task error: Bad window span (12) for length 10.
which seems to originate in splitapplycombine.jl part of Dataframes package, but I cant quite figure out why - is it some soft of memory limit I am hitting with how dataframes can be used in Julia?
edit: issue seems to happen only when df gets over 8000 rows or so, and then the error starts showing up…