Hi
I wonder why FME sometimes add more decimals.
For example:
If I import the number 652314.30, FME sometimes convert it to 652314.300000004
Does anyone know why?
I see this problem quite often and I solve it with the string formatter.
/Fredrik
Page 1 / 1
This is a very common complaint when doing floating point arithmetic outside of Excel etc which tends to mask the underlying issue, which isn't related to FME but to how floating point numbers are stored and manipulated by the computer.
This is a good resource that explains in simple terms what's happening: https://floating-point-gui.de/
Hi!
I have this problem all the time. Is there a way to limit the number of decimals for a given value using the amount of decimals it has when it is read?
Hi!
I have this problem all the time. Is there a way to limit the number of decimals for a given value using the amount of decimals it has when it is read?
Did you try the AttributeRounder?