I am running through the 60 minute blitz in flux’s model zoo and was looking for some clarity on functions that I havn’t seen before. I am on line 205 and I am struggling to understand what the Dense function does, as well as what the relu option does. I have not been able to find documentation of functions in flux (?Dense returns that no documentation was found).
I know that this function somehow creates a dense layer in a neural net, and presumably the numbers are the number of columns and rows of the multiplication matrix in this layer? But I have so far had to learn just based on inference regarding what was going on. Can someone briefly explain either where I can find the documentation for functions in packages or alternately what
Dense(10,5, relu) (model zoo, 60 minute blitz, line 205) does?