Skip to main content
  • EN
  • Home
  • Forums
  • FME Form
  • General
  • Hi Superfluous decimals are added to certain numbers already containing decimals, but not on whole numbers. Sometimes the decimal already present is reduced. Can you help me so that I suggest a possible solution?

Examples:

10 > 10

5.1 > 5.09999990463256

10.1 > 10.100000381469727

20.1 > 20.100000381469727

17.6 > 17.600000381469727

20.3 > 20.299999237060547

8.4 > 8.399999618530273

5.3 > 5.30000019073486

207.97 > 207.97000122070312

You can use an AttributeRounder to fix that.

You can use @round in the Arithmatic Editor:

@round(@CurrentAttribute(),5)

 

Reply


Community Stats

30,162
Posts
114,483
Replies
37,810
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.