Skip to main content
Solved

From string type to double type and reduce the decimals

J

Hi,

I have an attribute (string type) with values such as 37908.907836. If I use an AtributeRounder, I can reduce it to 37908.907. That's ok. But if I convert the string type to double type, the decimals comes again...

 

I have tried to convert first and to apply the AttributeRounder later but it doesn't work. Any suggestion?

 

Thanks!

Best answer by david_r

This is unfortunately the way floating point numbers work in computers, see https://floating-point-gui.de/

View original
Did this help you find an answer to your question?

2 replies

david_r
Celebrity
  • david_rCelebrity
  • Best Answer
  • May 29, 2020

This is unfortunately the way floating point numbers work in computers, see https://floating-point-gui.de/

J

Oh! I didn't know that! Thanks a lot for the answer!

 

Reply


Helpful Members This Week

Community Stats

31,187
Posts
118,231
Replies
38,797
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.