Skip to main content
Question

duplicatefilter unique port returns always 5000 features

  • December 14, 2018
  • 7 replies
  • 64 views

Forum|alt.badge.img

Result of duplicatefilter unique port is always 5000 features, irrespective of the number of input features.

Is there a kind of FME default value of maximum features I have to change/increase?

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

7 replies

Forum|alt.badge.img
  • Author
  • December 14, 2018

to be more precise: max. unique features always 5000 was mentioned, number of input features for instance 135.000 or 200.000


takashi
Celebrity
  • December 14, 2018

I don't think there is such a limitation on the maximum number of unique features that would be filtered by the DuplicateFilter. Is 5000 wrong number?


ebygomm
Evangelist
Forum|alt.badge.img+51
  • Evangelist
  • December 14, 2018

Do you know that there are more than 5000 unique features? It doesn't necessarily follow that the number of unique features increases as the number of features increases. It entirely depends on your data and which feature(s) you are comparing.


erik_jan
Contributor
Forum|alt.badge.img+26
  • Contributor
  • December 14, 2018

This seems to be a case for www.safe.com/support

Might be some kind of hidden feature.


erik_jan
Contributor
Forum|alt.badge.img+26
  • Contributor
  • December 14, 2018

This seems to be a case for www.safe.com/support

Might be some kind of hidden feature.

Tried to reproduce in FME 2018.0, but could not:


david_r
Celebrity
  • December 14, 2018

I've used the DuplicateFilter a lot and I've never had any problems that couldn't be traced back to something unexpected in the input data.

So my recommendation is to take a long, hard look at the data that enters the DuplicateFilter.


Forum|alt.badge.img
  • Author
  • December 15, 2018

As suggested, I investigated the input data in parallel and in fact, these results correspond to the unique port result, they are equal. Thank you guys!