I am just getting started with Flux.
While the documentation is present, I have a hard time finding some information.
In particular, these are some questions that came up:
- am I to use Zygote or the Tracker module? Which one is used for the latest Flux, has Flux already transitioned to Zygote?
- are there examples for writing my own “layer”? More precisely, I would like to use a SVD and a derivative that I found in some paper.
- Somewhat more detailed question: I have an operation Diagonal(w)) * A, where w is an Array and A is an Array (a matrix). This works fine without Flux, but if w is containing tracked values, Julia complains that it does not have an implementation for the multiplication operator (*).
I’m sure I’m doing something wrong that is obvious for the Flux expert.
… I know how to get this done in PyTorch, but I would love to try out Flux.