Skip to main content
Solved

Remove duplicate record

  • January 21, 2020
  • 1 reply
  • 1761 views
M

Hi there,

 

I have a record that consists of 10 attributes/columns. I want to remove duplicate from the record. The duplicate would be based on the value of 5 attributes. When I say duplicate, it means that reduce the number of duplicate records to 1. I read the existing thread on the forum where someone recommended to use Matcher. However, Matcher categorizes the record into duplicate and non-duplicate. I don't want categorization. I want to reduce the duplicate records to 1 record. I also tried to use ListDuplicateremover, the problem in that was it only showed the name of one attribute. Any suggestion

Best answer by bwn

If the situation is removing duplicate records (ie. Multiple features with the same attribute values) then DuplicateFilter removes the duplicates and outputs the first unique record/feature on the Unique port with no duplicates.

Matcher is instead for removing duplicate geometries with an option to constrain this to matching attributes as an additional Duplicate criteria. It wouldn't do a purely attribute based check.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

bwn
Evangelist
Forum|alt.badge.img+26
  • bwnEvangelist
  • Evangelist
  • 562 replies
  • Best Answer
  • January 21, 2020

If the situation is removing duplicate records (ie. Multiple features with the same attribute values) then DuplicateFilter removes the duplicates and outputs the first unique record/feature on the Unique port with no duplicates.

Matcher is instead for removing duplicate geometries with an option to constrain this to matching attributes as an additional Duplicate criteria. It wouldn't do a purely attribute based check.

Community Stats

32,078
Posts
121,802
Replies
39,709
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.