How to best model different domains in Optimization, especially Manifolds?

Well after my first (wrong) statement I already said that it might get better with a second order one (the wording above was intentionally but probably slower).

And we are a bit away from the original topic by now.