# \#natural-gradient

**URL:** https://discourse.julialang.org/tag/natural-gradient/543.md

[Latest](https://discourse.julialang.org/latest.md) · [Categories](https://discourse.julialang.org/categories.md) · [Tags](https://discourse.julialang.org/tags.md)

---

## [Help with Jacobian vector product to get natural gradient](https://discourse.julialang.org/t/help-with-jacobian-vector-product-to-get-natural-gradient/51115)

<div class="topic-metadata">

**Author:** [@theogf](https://discourse.julialang.org/u/theogf)\
**Replies:** 16\
**Last updated:** [February 18, 2022, 12:15am UTC](https://discourse.julialang.org/t/help-with-jacobian-vector-product-to-get-natural-gradient/51115 "2022-02-18T00:15:53Z")

</div>

Hi I am trying to reproduce an algorithm based on Natural gradient computations (Natural Gradients in Practice - Salimbeni et al 2018). The key computation is that you can get rid of the inverse Fisher Information matr…

---

## [Zygote - parametrize matrix such that gradient is only performed on selected coefficients](https://discourse.julialang.org/t/zygote-parametrize-matrix-such-that-gradient-is-only-performed-on-selected-coefficients/62393)

<div class="topic-metadata">

**Author:** [@jgbrasier](https://discourse.julialang.org/u/jgbrasier)\
**Replies:** 1\
**Last updated:** [June 5, 2021, 5:34am UTC](https://discourse.julialang.org/t/zygote-parametrize-matrix-such-that-gradient-is-only-performed-on-selected-coefficients/62393 "2021-06-05T05:34:14Z")

</div>

I was wondering if it was possible to parametrize matrices such that zygote’s gradient would only be performed on the selected coefficients of the matrix. Some dummy code would look like: theta = randn(2) W = \[theta\[1\]…