# How to implement custom weight initialization in Flux?

**URL:** https://discourse.julialang.org/t/how-to-implement-custom-weight-initialization-in-flux/77876
**Category:** General Usage
**Created:** [March 14, 2022, 4:22pm UTC](https://discourse.julialang.org/t/how-to-implement-custom-weight-initialization-in-flux/77876 "2022-03-14T16:22:46Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![DeepQ](https://avatars.discourse-cdn.com/v4/letter/d/2bfe46/32.png) [@DeepQ](https://discourse.julialang.org/u/DeepQ)
#### Post date: [March 14, 2022, 4:22pm UTC](https://discourse.julialang.org/t/how-to-implement-custom-weight-initialization-in-flux/77876/1 "2022-03-14T16:22:46Z")

</div>

How could I define custom weight initialization in Flux? The solution should be clean. Documentation is confusing. Should I define the Dense layer from scratch?

---

<div class="post-metadata">

### Author: ![ToucheSir](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/touchesir/32/14411_2.png) [@ToucheSir](https://discourse.julialang.org/u/ToucheSir)
#### Post date: [March 14, 2022, 5:15pm UTC](https://discourse.julialang.org/t/how-to-implement-custom-weight-initialization-in-flux/77876/2 "2022-03-14T17:15:21Z")

</div>

We don’t have any docs about custom init functions, if you have any ideas for additions there they would be very welcome. For now I would recommend following the pattern used by functions in [Utility Functions · Flux](https://fluxml.ai/Flux.jl/stable/utilities/#Layer-Initialization). TL;DR all you need is a function that takes dims and returns an initialized array.