The following remainder calculations are a bit surprising to me, as I’d expect to get a remainder of 0 (or something like ~1e-18) in each case. I guess there is some floating point issue: julia> rem(500,0.625) 0.0 julia> rem(50,0.0625) 0.0 julia> rem(5,0.00625) 0.006249999999999723 julia> rem(…

[image] _bernhard: This is exactly what happens in your example - the divisor (and dividend) is rounded to the nearest float In particular, 0.00625 is not exactly representable in binary floating point, so it is rounded to a slightly larger value: julia> big(0.00625) 0.0062500000000000003469…

Calculation of remainder, floating point issues

General Usage

stevengj Split this topic August 30, 2023, 12:31pm 9

3 posts were split to a new topic: Printing exact decimal representations

Topic		Replies	Views
PSA: floating-point arithmetic Offtopic	14	7448	July 8, 2021
Numerical precision General Usage question , precision	15	1603	March 31, 2022
Unexpected Behaviour of the Rounding Function General Usage	7	759	April 6, 2022
Divising a DateTime by 1 or 10 yields different floating point precision New to Julia	3	61	July 22, 2024
Why do simple arithmetics cause weird Precision bugs General Usage	10	285	September 10, 2024

Calculation of remainder, floating point issues

Related topics