Yes, of course. But Nelder Mead variants with convergence guarantees also exist.
(The Nelder Mead implemented in Optim.jl is a more modern improvement, indeed. It doesn’t seem to have convergence results, though, but behaves better than the classical method)