Skip to main content
Question

How to use "Duplicate filter"?

  • June 8, 2022
  • 6 replies
  • 278 views

Forum|alt.badge.img

In my attribute table, I have a field named "City" and in this field we have differents cities except a city which is in 2 or 3 fields. But the transformer "Duplicate filter" doesn't display this information and displays cities which are uniques. So I think it doesn't work. What is the problem?

 

Thanks for helping

6 replies

geomancer
Evangelist
Forum|alt.badge.img+58
  • Evangelist
  • 932 replies
  • June 8, 2022

When you set the attribute "City" in the Key Attributes parameter, the first feature passing through the DuplicateFilter with a certain city name in attribute "City" will exit through the 'Unique' port, all consequent features with the exact same city name in attribute "City" will exit through the 'Duplicate' port.

DuplicateFilter


jdh
Contributor
Forum|alt.badge.img+36
  • Contributor
  • 2001 replies
  • June 8, 2022

The duplicateFilter has two ports.

The first time a value is encountered it is output through the Unique port. Any subsequent features with that value are output through the Duplicate port.

 

So if you had 3 features with Vancouver, the first would come out the unique port along with the rest of the cities, while the remaining 2 Vancouver features would be in the duplicate port.

 

You may be more interested in the Matcher transformer, which will send all 3 Vancouvers to the Matched port .


  • 3 replies
  • June 9, 2022

I was also confused about the UniqueFilter, since features in the Unique port don't have to be unique values.

 

You can also use StatisticsCalculator with "Group Processing" and "Total Count", which is faster than the Matcher transformer.


Forum|alt.badge.img

When you set the attribute "City" in the Key Attributes parameter, the first feature passing through the DuplicateFilter with a certain city name in attribute "City" will exit through the 'Unique' port, all consequent features with the exact same city name in attribute "City" will exit through the 'Duplicate' port.

DuplicateFilter

Thank you!


Forum|alt.badge.img

The duplicateFilter has two ports.

The first time a value is encountered it is output through the Unique port. Any subsequent features with that value are output through the Duplicate port.

 

So if you had 3 features with Vancouver, the first would come out the unique port along with the rest of the cities, while the remaining 2 Vancouver features would be in the duplicate port.

 

You may be more interested in the Matcher transformer, which will send all 3 Vancouvers to the Matched port .

Thanks :)


Forum|alt.badge.img

I was also confused about the UniqueFilter, since features in the Unique port don't have to be unique values.

 

You can also use StatisticsCalculator with "Group Processing" and "Total Count", which is faster than the Matcher transformer.

Thank you!