Skip to main content
Solved

Removing Duplicate values from the column

  • April 19, 2018
  • 3 replies
  • 49 views

parashari
Forum|alt.badge.img+2

Hi, I have a column 'Flag', where there are duplicate values seperated by '_&_' and I want to remove the duplicate values from it. I tried using the AttributeSplitter and creating Lists, but seemed to be too long. Can we do it with some other way? May be regex or list or something new?

Best answer by takashi

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

3 replies

takashi
Celebrity
  • 7843 replies
  • Best Answer
  • April 19, 2018

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?


parashari
Forum|alt.badge.img+2
  • Author
  • 132 replies
  • April 20, 2018

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?

That really works for me.

 

But, when I see the output of AttributeSplitter and ListDuplicateRemover, no difference is visible, but suddenly the required out is displayed. I am guessing we are creating a list first (AttributeSplitter), removing the duplicates (ListDuplicateRemover) and then concatenating the required results with a seperator (ListConcatenator). Is it?

 

Where all can we use these combinations or other such combination?

 

Well, thanks for a quick help @takashi :)

 


takashi
Celebrity
  • 7843 replies
  • April 20, 2018

Hi @hellblazer, have you tried a chain of AttributeSplitter, ListDuplicateRemover and ListConcatenator?

Yes, your observation is correct. That's the procedure exactly I intended.