Page 1 of 1

Calculator bug

Posted: Wed Dec 13, 2017 6:20 am
by djreiswig
I was messing with the calculator plugin today and remembered that there used to be a bug in the Windows calc ages ago. I thought I'd see if this one suffered from this bug. Turns out it does. I think it has to do with a rounding error, but I don't remember. To see the bug try entering 3.11 - 3.10. It should show 0.01, but it shows 0.0099999999999998.