Skip to main content
Question

trying to speed up output of 350+ large size GeoTIFFs

  • June 26, 2019
  • 1 reply
  • 39 views
clindsey
Contributor
Forum|alt.badge.img+3

I am attempting to write out 386 geotiffs and each is over 1.5 Gbs in size. It's taking about 15mins to write out each file. I am using parallel processing however when looking at task manager it seems that only 1 CPU is running / writing at a time. I'm looking for some authoring critique or insight as to what i can do to speed up the process. The workflow is attached as well as a screenshot of task manager

 

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

sigtill
Supporter
Forum|alt.badge.img+25
  • sigtillSupporter
  • Supporter
  • October 23, 2019

Hi @clindsey

1. Use a FeatureWriter instead of the Writer - this will make FME start to write the file at once instead of keeping all data in memory

2. Use the WorkspaceRunner on each file: https://www.safe.com/transformers/workspace-runner/

 

The real SigTill

Community Stats

32,182
Posts
122,173
Replies
39,855
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.