The issue might be that Distributions.jl still uses some C libraries (Rmath, openspecfun). There was some discussion to port them in Julia but I’m not sure what’s the status of that.
Sometimes I just translate scipy code for probability distributions when I need automatic differentiation.