Skip to main content
Question

How to use "Duplicate filter"?


Forum|alt.badge.img

In my attribute table, I have a field named "City" and in this field we have differents cities except a city which is in 2 or 3 fields. But the transformer "Duplicate filter" doesn't display this information and displays cities which are uniques. So I think it doesn't work. What is the problem?

 

Thanks for helping

6 replies

geomancer
Evangelist
Forum|alt.badge.img+47
  • Evangelist
  • June 8, 2022

When you set the attribute "City" in the Key Attributes parameter, the first feature passing through the DuplicateFilter with a certain city name in attribute "City" will exit through the 'Unique' port, all consequent features with the exact same city name in attribute "City" will exit through the 'Duplicate' port.

DuplicateFilter


jdh
Contributor
Forum|alt.badge.img+28
  • Contributor
  • June 8, 2022

The duplicateFilter has two ports.

The first time a value is encountered it is output through the Unique port. Any subsequent features with that value are output through the Duplicate port.

 

So if you had 3 features with Vancouver, the first would come out the unique port along with the rest of the cities, while the remaining 2 Vancouver features would be in the duplicate port.

 

You may be more interested in the Matcher transformer, which will send all 3 Vancouvers to the Matched port .


I was also confused about the UniqueFilter, since features in the Unique port don't have to be unique values.

 

You can also use StatisticsCalculator with "Group Processing" and "Total Count", which is faster than the Matcher transformer.


Forum|alt.badge.img
geomancer wrote:

When you set the attribute "City" in the Key Attributes parameter, the first feature passing through the DuplicateFilter with a certain city name in attribute "City" will exit through the 'Unique' port, all consequent features with the exact same city name in attribute "City" will exit through the 'Duplicate' port.

DuplicateFilter

Thank you!


Forum|alt.badge.img
jdh wrote:

The duplicateFilter has two ports.

The first time a value is encountered it is output through the Unique port. Any subsequent features with that value are output through the Duplicate port.

 

So if you had 3 features with Vancouver, the first would come out the unique port along with the rest of the cities, while the remaining 2 Vancouver features would be in the duplicate port.

 

You may be more interested in the Matcher transformer, which will send all 3 Vancouvers to the Matched port .

Thanks :)


Forum|alt.badge.img
mschorcht wrote:

I was also confused about the UniqueFilter, since features in the Unique port don't have to be unique values.

 

You can also use StatisticsCalculator with "Group Processing" and "Total Count", which is faster than the Matcher transformer.

Thank you!

 


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings