Specifically, I’m interested in the attention mechanism described in Listen, Attend and Spell work (where it’s referred to as AttentionContext), but more generally any other kind of attention’s implementation would be quite useful to take a look at.

Is there an implementation of the attention mechanism in Flux.jl?

Volker September 23, 2020, 6:49am 6

Maybe this links are interesting for you:

2 Likes