Just found this thread from a couple of years ago mentioning an idea that actually relates to this topic, “recursive broadcasts”…
In my opinion the best approach would be to have a data-structure that can be easily mapped to/from arrays of arrays, and then support mapping etc (isomorphism? catamorphism? I forgot the correct term). There’s an AbstractTrees module, but I’m not sure how easy is it to use that.