|
![](/i/fill.gif) |
Alain <aze### [at] qwerty org> wrote:
> If you have a value of about 1e100, then, the last digit presision would
> be about 1e90 to 1e93. This is a serious loss of precision.
Note that a double-precision floating point number (which is 64 bits
in size) has only 53 bits of precision for the base. That's approximately
15 digits of precision in base 10. (In other words, if you try to store
a number with more significant decimal digits than 15 into such a floating
point value, the lower ones will just be lost.)
I assume 1e7 was chose as half of that.
--
- Warp
Post a reply to this message
|
![](/i/fill.gif) |