As I have said, this is really the problem of finite difference jacobian estimation. I have checked the stacktrace of DomainError, and there was a function called something like jacobian_finite_difference (up to reordering of the words).
I have passed autodiff=forward to curve_fit, and the problem was solved.