Faster matmul

[tomtom]

https://arstechnica.com/information-technology/2024/03/matrix-multiplication-breakthrough-could-lead-to-faster-more-efficient-ai-models/

Would Julia implement new matmul algo like above?

[jar1]

See this thread from the last time a matmul algorithm came out

Asymptotically faster matrix-multiplication algorithms

Does there even exist an actual implementation?

[gdalle]

Advances in the matrix multiplication algorithm

The laser method is not intended to be practical; it’s just a way to think about the ideal way to multiply matrices. “We never run the method [on a computer],” Zhou said. “We analyze it.”

[abraemer]

Faster asymptotically does not imply faster in practice. One reason is that moderm CPUs are very complicated and perform lots of optimizations such that the number of operations is not a proxy for execution speed. Another reason is that the big-O notation hides the constant factors which are ginormous for these “fast” matrix multiplication making it a galactic algorithm.