Flux gradients intepretation

You can index the Grads struct returned from gradient with the parameter arrays in params(rnn) (i.e. your model’s parameters) to get the gradient for a specific parameter. e.g. grads_seq[rnn.cell.Wi].

1 Like