Skip to main content
Solved

Removing Duplicate values from the column


parashari
Forum|alt.badge.img+2

Hi, I have a column 'Flag', where there are duplicate values seperated by '_&_' and I want to remove the duplicate values from it. I tried using the AttributeSplitter and creating Lists, but seemed to be too long. Can we do it with some other way? May be regex or list or something new?

Best answer by takashi

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?

View original
Did this help you find an answer to your question?

3 replies

takashi
Contributor
Forum|alt.badge.img+21
  • Contributor
  • Best Answer
  • April 19, 2018

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?


parashari
Forum|alt.badge.img+2
  • Author
  • April 20, 2018
takashi wrote:

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?

That really works for me.

 

But, when I see the output of AttributeSplitter and ListDuplicateRemover, no difference is visible, but suddenly the required out is displayed. I am guessing we are creating a list first (AttributeSplitter), removing the duplicates (ListDuplicateRemover) and then concatenating the required results with a seperator (ListConcatenator). Is it?

 

Where all can we use these combinations or other such combination?

 

Well, thanks for a quick help @takashi :)

 


takashi
Contributor
Forum|alt.badge.img+21
  • Contributor
  • April 20, 2018
takashi wrote:

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?

Yes, your observation is correct. That's the procedure exactly I intended.

 

 


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings