Skip to main content
Solved

is it possible to avoid reading all features but the ones specified?

  • September 2, 2021
  • 2 replies
  • 16 views
L
Forum|alt.badge.img+1

Hi all,

My question is regarding performance actually...

I'm going through a process of reading data (shp) trimming it, doing change detection and writing it to a sde. Some of my data contains 5.000.000 objects, so it takes forever to run it, which is not a problem in production mode.

 

In the testing fase, when tweeking and changing settings it is a big hazzle though. I have added a tester to both my original data source and the revised data source to filter out a small portion of data, but it still has to go through every single object when reading the data...

 

So my question is: Is there a way to avoid having to read everything from both datasets?

 

Thanks :-)

Best answer by nielsgerrits

One way to do this is to use a polygon to select only a part of the data in test.

This can be done with FeatureReaders, first read the polygon, then read the data with a spatial filter.

This will work by default for SDE, the shape set will need a spatial index tho, but you can do that using FME (Esri Shapefile Parameters, Write Spatial Index).

View original
Did this help you find an answer to your question?
This post is closed to further activity.
It may be a question with a best answer, an implemented idea, or just a post needing no comment.
If you have a follow-up or related question, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

nielsgerrits
VIP
Forum|alt.badge.img+59
  • nielsgerritsVIP
  • Best Answer
  • September 3, 2021

One way to do this is to use a polygon to select only a part of the data in test.

This can be done with FeatureReaders, first read the polygon, then read the data with a spatial filter.

This will work by default for SDE, the shape set will need a spatial index tho, but you can do that using FME (Esri Shapefile Parameters, Write Spatial Index).

L
Forum|alt.badge.img+1
  • larsec
  • Author
  • September 3, 2021

Hi Niels,

Thank you for your answer - sounds like a sensible solution, I will give it a try :-)

Thanks

Helpful Members This Week

Community Stats

31,840
Posts
120,943
Replies
39,474
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.