Table of Automatic Differentiation Examples


We are maintaining a table of AD examples in a variety of languages. There are five example programs, with varying levels of dynamic behaviour and amounts of nesting of AD operators. This has a number of uses. One is benchmarking, but more interestingly, it can be used as a bit of a regression test, it can help chase down rough corners of both AD APIs and AD implementations, and it can be used to showcase some of the power of AD.

We’re hoping to fill out more rows, with more languages. Julia and its AD packages would make a nice addition, so I’m hoping someone in the community will take up the mantle. The example programs are already translated into a bunch of languages, including SML, OCAML, and Haskell, so translating into Julia should be reasonably mechanical.

I’m not subscribed to this list, so feel free to communicate either on the above repo, or by email to me: Barak A. Pearlmutter