It depends on what you’re trying to do. Generally if you spend enough time with a deep neural network you can get something that’s a “little better”, but Surrogates.jl has a lot of the classic methods like GLKPLS that just kind of work without too much tweaking. They are different kinds of methods and which one you use depends on the situation.
We find reservoir computing approaches tend to be the most robust.