Pkg DoubleFloats, some consts flawed

derSchorsch
Thu, 21 Mar 2024 05:58:09 +0000
Numerics

Hi all, I have noticed that many of the constants related to pi in the file sequences.jl of pkg DoubleFloats are flawed. For example, the DD values for (15/32)*%pi read:
"Double64(1.4726215563702156, -5.3616983752483455e-17),"
whereas my PY/MX/JL-scripts as well as the XL-addin XNumbers compute:

DDhi: +1.4726215563702156341e+00...  ,  3F F7 8F DB 9E FF EA 47
DDlo: -5.3616983752483473226e-17 ; BC 8E E8 78 60 39 D3 73     .

So in this example, DoubleFloats-DDlo is off by 3 ULPs. Any ideas??

2 posts - 2 participants