Flux and Octavian

qwerty · November 4, 2022, 9:50am

Does Flux use Octavian when run on cpu?

baggepinnen · November 4, 2022, 10:06am

No, but SimpleChains.jl uses LoopVectorization

PumasAI/SimpleChains.jl/blob/main/src/dense.jl#L182


      
          @inline function dense!(
            f::F,
            C::AbstractVecOrMat{<:Base.HWReal},
            A::AbstractMatrix{<:Base.HWReal},
            B::AbstractVecOrMat{<:Base.HWReal},
            ::True,
            ::True,
          ) where {F}
            Kp1 = ArrayInterface.size(A, StaticInt(2))
            K = Kp1 - StaticInt(1)
            @turbo for n ∈ indices((B, C), 2), m ∈ indices((A, C), 1)
              Cmn = zero(eltype(C))
              for k ∈ 1:K
                Cmn += A[m, k] * B[k, n]
              end
              C[m, n] = f(Cmn + A[m, Kp1])
            end
          end
          @inline function dense!(
            f::F,
            C::AbstractVecOrMat{<:Base.HWReal},

Topic		Replies	Views
[ANN] LoopVectorization Package Announcements	157	23801	May 27, 2020
ANN: LoopVectorization 0.12: multithreading and better handling of discontiguous memory accesses Performance	16	2245	March 17, 2021
Flux vs pytorch cpu performance Machine Learning first-steps , flux	59	9475	October 2, 2020
Flux.jl MethodError ... (::Dense{typeof(identity),... on simple Chain model Machine Learning	3	1161	October 17, 2019
How to make LoopVectorization work with computing Euclidean distance for every column? New to Julia tullio , loopvectorization	13	1161	August 21, 2020

Flux and Octavian

Related topics