Skip to main content

Hi, i am cliping 7.000.000 fetaures and after 5.000.000 milions of read fetaures it stucks - program starts to make some low level intersections. I woul like to perform 30 independent dwg files from shapes with 7 milion of features. I do it with tester transformer. In ARGIS modelbuilder i used to do this with Feature iterator - are there any similar options?

Program runs very slow for 2 days and it is unable to perform cliped outputs. I think there is a memory issue, can you help me? i have 32gb ram availible and new i7 processor. FME softeware is 32 bit.

How are the Clippers configured? Is it possible to configure them for "Clippers first", if that isn't already the case? That could have a huge impact on performance and memory consumption.

Also, you should consider using 64-bit FME. Unfortunately 32-bit software (including FME) cannot use more than about 2 GB of RAM, so your 32 GB of RAM sits mostly unused in this scenario. 64-bit software does not have this limitation and could help speed things up by using all of your available memory.

If nothing else works, you could iterate over the input features using a master workspace that runs the clipping workspace using e.g. the WorkspaceRunner. You can there parametrize which block to process using a published parameter. But my tip is to start with the top two recommendations first.


How are the Clippers configured? Is it possible to configure them for "Clippers first", if that isn't already the case? That could have a huge impact on performance and memory consumption.

Also, you should consider using 64-bit FME. Unfortunately 32-bit software (including FME) cannot use more than about 2 GB of RAM, so your 32 GB of RAM sits mostly unused in this scenario. 64-bit software does not have this limitation and could help speed things up by using all of your available memory.

If nothing else works, you could iterate over the input features using a master workspace that runs the clipping workspace using e.g. the WorkspaceRunner. You can there parametrize which block to process using a published parameter. But my tip is to start with the top two recommendations first.

Thanks for the quick answer,

 

 

I have set the clipper to "clippers first", I have to see what it can be done in the company for upgrading to 64 bit FME.

 

 

Bye, Miha

 

 

 


I would use 2 workspaces to do this.

 

First workspace to initiate a second one using a workspacerunner.

 

Second workspace to run per clipper. Read (FeatureReader!) only the to be clipped features that intersect with the clipper, clip them, write them to dwg, write a status succesful to the clipper table. This way you can stop and start the process without trashing the already done work.