Help reducing compilation and inference time

RAM usage is stable, around 5 GBs during compilation out of 32 GBs.

1 Like