https://arstechnica.com/information-technology/2024/03/matrix-multiplication-breakthrough-could-lead-to-faster-more-efficient-ai-models/ Would Julia implement new matmul algo like above?

See this thread from the last time a matmul algorithm came out [image] Asymptotically faster matrix-multiplication algorithms Offtopic Does there even exist an actual implementation?

[image] Advances in the matrix multiplication algorithm Offtopic The laser method is not intended to be practical; it’s just a way to think about the ideal way to multiply matrices. “We never run the method [on a computer],” Zhou said. “We analyze it.”

Faster asymptotically does not imply faster in practice. One reason is that moderm CPUs are very complicated and perform lots of optimizations such that the number of operations is not a proxy for execution speed. Another reason is that the big-O notation hides the constant factors which are ginormo…

Faster matmul

Specific Domains Numerics

gdalle March 9, 2024, 9:49am 3

Topic		Replies	Views
Advances in the matrix multiplication algorithm Offtopic	2	600	March 8, 2024
Algorithmic complexity of matrix multiplication in Julia Performance question	10	2119	March 20, 2021
Specialized matrix-matrix multiplication algorithm New to Julia question , performance , linearalgebra	5	498	July 9, 2024
@fastmath for matrices? Numerics question , linearalgebra , fast-math	6	1077	August 21, 2017
Why mul! is so fast? General Usage question , linearalgebra	7	7051	November 26, 2019

Faster matmul

Related topics