Flux: training loop logging for custom structure and model

That is odd. Can you confirm that logging/printing the values does show them changing over time? It would be good to rule out that part as a culprit.