See https://docs.juliadiffeq.org/latest/analysis/sensitivity/ . Just use concrete_solve and sensealg=ForwardDiffAdjoint(), and then Zygote.gradient will use ForwardDiff internally.
Otherwise, please post your error message since without the error message it’s much harder to debug.