Skip to main content
  • EN

I don't actually need a solution, but I'm just curious if there's a way to convert a number from a float to a decimal or vice versa in FME without resorting to python.

 

So for example reading some data as a decimal, which is then stored elsewhere as a float and you want to do some change detection and consider

56.358400000000003 to equal 56.3584

and

963.299000000000092 to equal 963.299

and

56.358499999999999 to equal 56.3585

 

 

I realised of course that you can also cast to a float in an inlinequerier, or even just change the input type to float. However, both python and the inlinequerier convert the middle example to 963.2990000000001 whilst writing to an oracle table with type FLOAT(126) results in a value of 963.299

 

I'm working round this by testing the abs difference between the two values but curious to know if there's a better way.

Reply


Community Stats

30,187
Posts
114,582
Replies
37,853
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.