Oh this is interesting. Indeed when I switch over to MNIST, it does learn and train but then not over the other dataset. Hm. I wonder if there is an error with the data somewhere?
Good thinking! However, I did try the BatchNorm function and no luck unfortunately. The values range between 0 to 1.
I’ll think on this some more but I think I shall also take a step back and see if there is something more fundamentally wrong with my data.
Thanks so much for the help!