StructuredOptimization can also handle simple neural nets, although it doesn’t come with stochastic optimisation techniques (but you can build those on top I believe). Plus, it currently doesn’t support GPU.
A simple demo is here.
1 Like