I closed a similar topic I opened about one hour ago by mistake, here I try again with clearer example, the issue is that the same LayerNorm layer in pytorch and Flux has large difference in performance and I don’t know if it is expected or not. If anybody could clarify this or tell me where to loo…

Flux LayerNorm slower than pytorch?

gpucce March 18, 2022, 3:22pm 3

Ok thanks! I didn’t go throught the code because I thought in no way I could understand it but I gues I could have. Then I gues that’s just how things are!!

Topic		Replies	Views
Flux.jl RNN performance Machine Learning	11	3172	October 28, 2018
Flux running slow? Machine Learning	16	2802	August 19, 2021
Flux vs pytorch cpu performance Machine Learning first-steps , flux	59	9471	October 2, 2020
Converting PyTorch to Flux while keeping performance Machine Learning flux , zygote	7	1464	May 29, 2022
Flux multi-cpu parallelism? New to Julia question , flux , zygote	9	2967	November 21, 2020

Flux LayerNorm slower than pytorch?

Related topics