Skip to main content
Solved

Is there a way to round parameters of tfw file

  • February 16, 2015
  • 1 reply
  • 20 views
zzupljanin
Contributor
Forum|alt.badge.img+4
Hi,

 

 

so, is there a way to round parameters of tfw file (e.g. 6 decimal places) while writing a tiff file.

 

 

I'm having a problem since FME changes the last (10th) decimal place of tfw file. And I'm using no transformers whatsoever.

 

 

PS. The resolution of original tiff is 0.2 and the last decimal of output tiff is 4. Does this have any correlation or is it just coincidence?

Best answer by david_r

Hi,

 

 

this sounds more like the general limitation of floating point arithmetic on computers than it does a problem with FME. See here for more info: http://floating-point-gui.de/formats/fp/

 

 

If you need to round of the coordinates, try using a CoordinateRounder.

 

 

David
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

david_r
Celebrity
  • david_rCelebrity
  • Best Answer
  • February 16, 2015
Hi,

 

 

this sounds more like the general limitation of floating point arithmetic on computers than it does a problem with FME. See here for more info: http://floating-point-gui.de/formats/fp/

 

 

If you need to round of the coordinates, try using a CoordinateRounder.

 

 

David

Community Stats

32,154
Posts
122,043
Replies
39,812
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.