Skip to main content
Solved

From string type to double type and reduce the decimals

  • May 29, 2020
  • 2 replies
  • 121 views
J

Hi,

I have an attribute (string type) with values such as 37908.907836. If I use an AtributeRounder, I can reduce it to 37908.907. That's ok. But if I convert the string type to double type, the decimals comes again...

 

I have tried to convert first and to apply the AttributeRounder later but it doesn't work. Any suggestion?

 

Thanks!

Best answer by david_r

This is unfortunately the way floating point numbers work in computers, see https://floating-point-gui.de/

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

david_r
Celebrity
  • david_rCelebrity
  • 8392 replies
  • Best Answer
  • May 29, 2020

This is unfortunately the way floating point numbers work in computers, see https://floating-point-gui.de/

J

Oh! I didn't know that! Thanks a lot for the answer!

 

Community Stats

32,076
Posts
121,790
Replies
39,702
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.