Skip to main content
Solved

Remove duplicates within a subset of data

  • March 8, 2016
  • 5 replies
  • 23 views

ngstoke
Contributor
Forum|alt.badge.img+1

I'm attempting to remove duplicate values, but only if they are within a subset of my data:

Is there a way to remove the duplicate 'Lease Number' within each unique 'Unit Name' ?

Best answer by gio

you can also create a list grouped by both columnnames, and then use a listindexer or histogrammer etc..

Or use a Matcher non geometric, then you can use bot attributes to find the uniques.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

5 replies

erik_jan
Contributor
Forum|alt.badge.img+23
  • Contributor
  • March 8, 2016

The DuplicateRemover transformer can be used on multiple attributes. The Unique output port will generate what you need.


ngstoke
Contributor
Forum|alt.badge.img+1
  • Author
  • Contributor
  • March 8, 2016

The DuplicateRemover transformer can be used on multiple attributes. The Unique output port will generate what you need.

Hi erik_jan,

I've tried the transformer you suggested, in different combinations am I missing something? The only output in all these combinations is '1 Alpha'


gio
Contributor
Forum|alt.badge.img+15
  • Contributor
  • Best Answer
  • March 8, 2016

you can also create a list grouped by both columnnames, and then use a listindexer or histogrammer etc..

Or use a Matcher non geometric, then you can use bot attributes to find the uniques.


erik_jan
Contributor
Forum|alt.badge.img+23
  • Contributor
  • March 8, 2016

Hi erik_jan,

I've tried the transformer you suggested, in different combinations am I missing something? The only output in all these combinations is '1 Alpha'

You want one DuplicateRemover with both attributes selected:


ngstoke
Contributor
Forum|alt.badge.img+1
  • Author
  • Contributor
  • March 8, 2016

you can also create a list grouped by both columnnames, and then use a listindexer or histogrammer etc..

Or use a Matcher non geometric, then you can use bot attributes to find the uniques.

That worked! Thanks for the help.