(approximate) PDFs/CDFs suitable for automatic differentiation?

But if I understand correctly, you have both the CDF and the PDF, so you can still define a method for it. Also, if you just define one for F(::ForwardDiff.Dual), it will take care of F(...)^2 etc. Look at the manual of ForwardDiff.