# Is there an implementation of the attention mechanism in Flux.jl?

**URL:** <https://discourse.julialang.org/t/is-there-an-implementation-of-the-attention-mechanism-in-flux-jl/26959>\
**Category:** Machine Learning\
**Tags:** flux\
**Created:** [July 29, 2019, 9:39pm UTC](https://discourse.julialang.org/t/is-there-an-implementation-of-the-attention-mechanism-in-flux-jl/26959 "2019-07-29T21:39:33Z")\
**Posts on this page:** 1\
**Showing post:** 6

<div class="post-metadata">

**Author:** ![Volker](https://avatars.discourse-cdn.com/v4/letter/v/77aa72/32.png) [@Volker](https://discourse.julialang.org/u/Volker)\
**Post date:** [September 23, 2020, 6:49am UTC](https://discourse.julialang.org/t/is-there-an-implementation-of-the-attention-mechanism-in-flux-jl/26959/6 "2020-09-23T06:49:40Z")

</div>

Maybe this links are interesting for you:

> **[GitHub - sdobber/FluxArchitectures.jl: Complex neural network examples for...](https://github.com/sdobber/FluxArchitectures.jl)**
>
> Complex neural network examples for Flux.jl. Contribute to sdobber/FluxArchitectures.jl development by creating an account on GitHub.

> **[FluxArchitectures: TPA-LSTM](https://sdobber.github.io/FA_TPALSTM/)**
>
> The next model in the FluxArchitectures repository is the Temporal Pattern Attention LSTM network based on the paper “Temporal Pattern Attention for Multivariate Time Series Forecasting” by Shih et. al.. It claims to have a better performance than...

---

_[View the full topic](https://discourse.julialang.org/t/is-there-an-implementation-of-the-attention-mechanism-in-flux-jl/26959)._