Skip to main content
Solved

Remove duplicate record

  • January 21, 2020
  • 1 reply
  • 1411 views
M

Hi there,

 

I have a record that consists of 10 attributes/columns. I want to remove duplicate from the record. The duplicate would be based on the value of 5 attributes. When I say duplicate, it means that reduce the number of duplicate records to 1. I read the existing thread on the forum where someone recommended to use Matcher. However, Matcher categorizes the record into duplicate and non-duplicate. I don't want categorization. I want to reduce the duplicate records to 1 record. I also tried to use ListDuplicateremover, the problem in that was it only showed the name of one attribute. Any suggestion

Best answer by bwn

If the situation is removing duplicate records (ie. Multiple features with the same attribute values) then DuplicateFilter removes the duplicates and outputs the first unique record/feature on the Unique port with no duplicates.

Matcher is instead for removing duplicate geometries with an option to constrain this to matching attributes as an additional Duplicate criteria. It wouldn't do a purely attribute based check.

View original
Did this help you find an answer to your question?

1 reply

bwn
Evangelist
Forum|alt.badge.img+26
  • bwnEvangelist
  • Evangelist
  • Best Answer
  • January 21, 2020

If the situation is removing duplicate records (ie. Multiple features with the same attribute values) then DuplicateFilter removes the duplicates and outputs the first unique record/feature on the Unique port with no duplicates.

Matcher is instead for removing duplicate geometries with an option to constrain this to matching attributes as an additional Duplicate criteria. It wouldn't do a purely attribute based check.

Reply


Helpful Members This Week

Community Stats

31,235
Posts
118,439
Replies
38,833
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.