Skip to main content
  • EN

Hi there,

 

I have a record that consists of 10 attributes/columns. I want to remove duplicate from the record. The duplicate would be based on the value of 5 attributes. When I say duplicate, it means that reduce the number of duplicate records to 1. I read the existing thread on the forum where someone recommended to use Matcher. However, Matcher categorizes the record into duplicate and non-duplicate. I don't want categorization. I want to reduce the duplicate records to 1 record. I also tried to use ListDuplicateremover, the problem in that was it only showed the name of one attribute. Any suggestion

If the situation is removing duplicate records (ie. Multiple features with the same attribute values) then DuplicateFilter removes the duplicates and outputs the first unique record/feature on the Unique port with no duplicates.

Matcher is instead for removing duplicate geometries with an option to constrain this to matching attributes as an additional Duplicate criteria. It wouldn't do a purely attribute based check.

Reply


Community Stats

31,756
Posts
120,637
Replies
39,380
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.