Consider the following operation, effectively raising 1.0003 to the zeroth power, which should give 1 to high precision. But the output answer is correct only to 2 digits. What am I doing wrong? setprecision(BigFloat, 2048) do N = BigFloat("1.0003") S = N^2 T = S^BigFloat("-2") prin…

First of all: welcome to our community! Second, my math may be rusty, but I think there is no reason why, for any number x, (x ^ 2) ^ -2 should give 1. julia> x = 11//10 11//10 julia> x ^ 2 121//100 julia> (x ^ 2) ^ -2 10000//14641 julia> float((x ^ 2) ^ -2) 0.6830134553650707 I think you are…

BigFloat loses precision on simple operations

New to Julia

jishnub November 28, 2020, 7:36am 5

No worries! Perhaps you could select the best answer and mark the question as solved?

1 Like

Topic		Replies	Views
BigInt precision issue General Usage	3	799	October 14, 2018
Zero and one do not respect precision of BigFloat General Usage	2	398	August 23, 2018
BigFloat precision issue Numerics	4	810	March 18, 2018
BigFloat wrong Numerics	7	680	August 26, 2019
Unexpected result about integer General Usage	13	1405	August 17, 2018

BigFloat loses precision on simple operations

Related topics