The following remainder calculations are a bit surprising to me, as I’d expect to get a remainder of 0 (or something like ~1e-18) in each case. I guess there is some floating point issue: julia> rem(500,0.625) 0.0 julia> rem(50,0.0625) 0.0 julia> rem(5,0.00625) 0.006249999999999723 julia> rem(…

[image] _bernhard: This is exactly what happens in your example - the divisor (and dividend) is rounded to the nearest float In particular, 0.00625 is not exactly representable in binary floating point, so it is rounded to a slightly larger value: julia> big(0.00625) 0.0062500000000000003469…

Calculation of remainder, floating point issues

General Usage

stevengj Split this topic August 30, 2023, 12:31pm 9

3 posts were split to a new topic: Printing exact decimal representations

Topic		Replies	Views
Does mod() work? Or am I high? General Usage	25	1592	September 19, 2018
Divrem maximum precision for the remain Numerics	14	599	November 3, 2020
How come integer division 6.0 by 0.2 returning 29 is correct? General Usage question	19	2188	October 22, 2018
Trouble understanding rem_pio2_kernel Numerics	2	793	September 24, 2018
Problem with trivial arithmetic New to Julia	7	854	January 6, 2021

Calculation of remainder, floating point issues

Related topics