Skip to main content
Solved

What is causing a difference in attribute handling with the AttributeManager (Arithmetic Editor)?


Forum|alt.badge.img

Hello,

I noticed a difference in attribute handling in my FME workbench. I hope anyone can explain what is causing this.

I have the following data:

With the AttributeManager I want to convert the numbers from meters to millimeters (see below).

The outcome of the AttributeManger is:

Why is the bottom value of the first row different than the other two rows?

It is luckily not an obstructing issue in my workbench, because I solved it with the AttributeRounder. But I am curious how this happens, and what the options are to prevent this from happening.

Thanks in advance!

Best answer by redgeographics

It has to do with the underlying mathematic model (I believe that is Tcl), although I am not sure what the exact reason is.

What you can do to avoid it alltogether is wrap the multiplication in an int() function like this:

@int(@Value(bottom)*1000)
View original
Did this help you find an answer to your question?

2 replies

redgeographics
Celebrity
Forum|alt.badge.img+50
  • Celebrity
  • Best Answer
  • February 4, 2020

It has to do with the underlying mathematic model (I believe that is Tcl), although I am not sure what the exact reason is.

What you can do to avoid it alltogether is wrap the multiplication in an int() function like this:

@int(@Value(bottom)*1000)

Forum|alt.badge.img
  • Author
  • February 4, 2020
redgeographics wrote:

It has to do with the underlying mathematic model (I believe that is Tcl), although I am not sure what the exact reason is.

What you can do to avoid it alltogether is wrap the multiplication in an int() function like this:

@int(@Value(bottom)*1000)

Thank you for your quick reply!


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings