Sorry for the stupid question, but it’s like in the title:
When using DataLoader
, if we don’t set shuffle=true
, will the gradient descent algorithm from Descent
always go through the batches/samples in the same order for every epoch? If yes, why isn’t shuffle set to true by default?