Hello, I just do the Coursera lectures about Deep Leanring by Andrew Ng, and want to implement what I learned in Julia (lecture is in Python), so I can check my understanding. So there is a small neural net, and it takes time, and I change the numerical type from Float64 to Float32 and get like 30%…

Massive performance penalty for Float16 compared to Float32

ChrisRackauckas November 3, 2017, 7:23pm 3

Don’t benchmark in the global scope. Put that in a function and run twice.

4 Likes

CSV Reading (rewrite in C?)

Topic		Replies	Views
Apples to apples comparison of A\b with Float64 and Float16 on A64FX Performance question , linearalgebra	12	789	May 2, 2022
Does float16 run natively on a compatible CPU? General Usage	14	585	July 11, 2024
Time it takes to multiply two floats Numerics float	2	429	August 18, 2022
Lux.jl Chain of Dense layers don't see speed up going from 32 bits -> 16 bits Performance machine-learning	5	934	August 7, 2022
Float16 with AMDGPU GPU	10	253	August 30, 2024