Skip to main content
Solved

Remove duplicates within a subset of data


ngstoke
Contributor
Forum|alt.badge.img+1

I'm attempting to remove duplicate values, but only if they are within a subset of my data:

Is there a way to remove the duplicate 'Lease Number' within each unique 'Unit Name' ?

Best answer by gio

you can also create a list grouped by both columnnames, and then use a listindexer or histogrammer etc..

Or use a Matcher non geometric, then you can use bot attributes to find the uniques.

View original
Did this help you find an answer to your question?

5 replies

erik_jan
Contributor
Forum|alt.badge.img+18
  • Contributor
  • March 8, 2016

The DuplicateRemover transformer can be used on multiple attributes. The Unique output port will generate what you need.


ngstoke
Contributor
Forum|alt.badge.img+1
  • Author
  • Contributor
  • March 8, 2016
erik_jan wrote:

The DuplicateRemover transformer can be used on multiple attributes. The Unique output port will generate what you need.

Hi erik_jan,

I've tried the transformer you suggested, in different combinations am I missing something? The only output in all these combinations is '1 Alpha'


gio
Contributor
Forum|alt.badge.img+15
  • Contributor
  • Best Answer
  • March 8, 2016

you can also create a list grouped by both columnnames, and then use a listindexer or histogrammer etc..

Or use a Matcher non geometric, then you can use bot attributes to find the uniques.


erik_jan
Contributor
Forum|alt.badge.img+18
  • Contributor
  • March 8, 2016
ngstoke wrote:

Hi erik_jan,

I've tried the transformer you suggested, in different combinations am I missing something? The only output in all these combinations is '1 Alpha'

You want one DuplicateRemover with both attributes selected:


ngstoke
Contributor
Forum|alt.badge.img+1
  • Author
  • Contributor
  • March 8, 2016
gio wrote:

you can also create a list grouped by both columnnames, and then use a listindexer or histogrammer etc..

Or use a Matcher non geometric, then you can use bot attributes to find the uniques.

That worked! Thanks for the help.


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings