How come math with decimals gives me results with too many digits?

Променена на Tue, 28 юли в 4:32 PM

The problem you're seeing is a fundamental issue with how computers typically do math.  It is usually referred to as a floating-point error.  Essentially, it comes down to the fact that it is very hard to represent .1 in binary (or .01, etc.), and you have to do some work to round the results a computer gives you to make it more accurate.


This recently came up on the team, and we have been discussing how to handle it.  The Say bubbles do some rounding of numbers, but can lead to some inaccuracies.  The think bubble gives slightly different results, and right now the team isn't in total agreement about which is preferred.  You can try running your answers through the say bubble or the "round" blocks.  

Here is some more information on floating point math: https://0.30000000000000004.com/.
And here's a video that gives a good explanation of the topic: https://www.youtube.com/watch?v=PZRI1IfStY0

Тази статия беше ли полезна?

Това е страхотно!

Благодарим Ви за обратната връзка

Съжаляваме, че не успяхме да бъдем полезни

Благодарим Ви за обратната връзка

Кажете ни как можем да подобрим тази статия!

Изберете поне една от причините
Изисква се CAPTCHA потвърждение.

Обратната връзка е изпратена

Оценяваме вашите усилия и ще се опитаме да поправим статията