The following remainder calculations are a bit surprising to me, as I’d expect to get a remainder of 0 (or something like ~1e-18) in each case. I guess there is some floating point issue: julia> rem(500,0.625) 0.0 julia> rem(50,0.0625) 0.0 julia> rem(5,0.00625) 0.006249999999999723 julia> rem(…

[image] _bernhard: This is exactly what happens in your example - the divisor (and dividend) is rounded to the nearest float In particular, 0.00625 is not exactly representable in binary floating point, so it is rounded to a slightly larger value: julia> big(0.00625) 0.0062500000000000003469…

Calculation of remainder, floating point issues

General Usage

stevengj Split this topic August 30, 2023, 12:31pm 9

3 posts were split to a new topic: Printing exact decimal representations

Topic		Replies	Views
Divrem maximum precision for the remain Numerics	14	656	November 3, 2020
Does mod() work? Or am I high? General Usage	25	1709	September 19, 2018
How come integer division 6.0 by 0.2 returning 29 is correct? General Usage question	19	2250	October 22, 2018
PSA: floating-point arithmetic Offtopic	14	7663	July 8, 2021
Problem with trivial arithmetic New to Julia	7	884	January 6, 2021

Calculation of remainder, floating point issues

Related topics