Solved

is it possible to avoid reading all features but the ones specified?

  • 2 September 2021
  • 2 replies
  • 0 views
L
Badge +1

Hi all,

My question is regarding performance actually...

I'm going through a process of reading data (shp) trimming it, doing change detection and writing it to a sde. Some of my data contains 5.000.000 objects, so it takes forever to run it, which is not a problem in production mode.

 

In the testing fase, when tweeking and changing settings it is a big hazzle though. I have added a tester to both my original data source and the revised data source to filter out a small portion of data, but it still has to go through every single object when reading the data...

 

So my question is: Is there a way to avoid having to read everything from both datasets?

 

Thanks :-)

icon

Best answer by nielsgerrits 3 September 2021, 06:42

View original

2 replies

nielsgerrits
Rank
Userlevel 6
Badge +32

One way to do this is to use a polygon to select only a part of the data in test.

This can be done with FeatureReaders, first read the polygon, then read the data with a spatial filter.

This will work by default for SDE, the shape set will need a spatial index tho, but you can do that using FME (Esri Shapefile Parameters, Write Spatial Index).

L
Badge +1

Hi Niels,

Thank you for your answer - sounds like a sensible solution, I will give it a try :-)

Thanks

Reply


Community Stats

28,714
Posts
109,490
Replies
36,561
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.