Recently I had a small problem with Julia that confused me. The code is shown below: Julia> x=2.0e-10 2.0e-10 Julia> -1.0*(-0.5*x^3 - 3.0*x^2 - 7.5*x - 7.5)*exp(-x)/x^6 + 1.0*(0.5*x^3 - 3.0*x^2 + 7.5*x - 7.5)*exp(x)/x^6 0.0 Julia> x=2.1e-10 2.1e-10 Julia> -1.0*(-0.5*x^3 - 3.0*x^2 - 7.5*x - 7.5)…

Numerical precision

precision, question

lmiq March 30, 2022, 2:44pm 3

Sometimes people are surprised by the results of floating-point calculations such as julia> 5/6 0.8333333333333334 # shouldn't the last digit be 3? julia> 2.6 - 0.7 - 1.9 2.220446049250313e-16 # shouldn't the answer be 0? These are not bugs in Julia. They’re consequences of the IEEE-standard 64-bit binary representation of floating-point numbers that is burned into computer hardware, which Julia and many other languages use by default. Brief explanation You can t…

4 Likes

show post in topic

Home
Categories
FAQ/Guidelines
Terms of Service
Privacy Policy

Powered by Discourse, best viewed with JavaScript enabled