Sorry for the stupid question, but it’s like in the title:
When using DataLoader, if we don’t set shuffle=true, will the gradient descent algorithm from Descent always go through the batches/samples in the same order for every epoch? If yes, why isn’t shuffle set to true by default?