Skip to main content

i would like to aggregate the data

so i used Aggregator Group by Main unique ID

Attributes to Concatenate 3 Attributes name that i want to combine

 

but i found each row has one Attribute main ID, and many id at the first and second (Attribute to Concatenate ) duplicated more than one but the third not , my question : how could i remove the duplicate IDs inside the attribute to Concatenate , i need only the unique IDs only if dupliated .

i tried Duplicate filter but it does not work .

 

after i used the aggreator attribute to oncentate submain 1,submain 2 ,submain 3 the ouput looks like that ,i would like to delete duplicate in each row at eaach attribute

 

 

 

Main

 

submain 1

 

submain 2

 

submain 3

 

5

 

2,5,4,4,3,3,4

 

6,6,3,2,2,5,1,5

 

9,4,7,8,2

 

 

 

FME 2018

so what should i do ,thanks for help

hi @gogopotter90, for me it's not completely clear what you want to do exactly, can you share some small sample of your data to clarify?


Instead of using the aggregator to concatenate, click the check box for list and select the unique key, on the output from the aggregator use a ListDuplicateRemover on the list, then use a ListConcatenator to concatenate the keys.

 

For this example, DIVISION is my attribute I'm using. Sort your records so it's in order.

 

List of duplicates

 

Duplicates removed

 

Concatenated records


Instead of using the aggregator to concatenate, click the check box for list and select the unique key, on the output from the aggregator use a ListDuplicateRemover on the list, then use a ListConcatenator to concatenate the keys.

 

For this example, DIVISION is my attribute I'm using. Sort your records so it's in order.

 

List of duplicates

 

Duplicates removed

 

Concatenated records

THANKS FOR UR method ,but in my case i do not have only one attribute and list concentae as u eplained i have tried ,i believe it is only to choose one attribute but at aaggregator ,i can choose more than attribute .

after i used the aggreator attribute to oncentate submain 1,submain 2 ,submain 3 the ouput looks like that ,i would like to delete duplicate in each row at eaach attribute

 

 

Main

 

submain 1

 

submain 2

 

submain 3

 

5

 

2,5,4,4,3,3,4

 

6,6,3,2,2,5,1,5

 

9,4,7,8,2

 

 

here it gives me relation between main and the another attribute ,in ur method can i get also relationship like here .so should i use two list duplicate remover for submain 1 and 2 or what should i do .

 

thanks


hi @gogopotter90, for me it's not completely clear what you want to do exactly, can you share some small sample of your data to clarify?

after i used the aggreator attribute to concentate submain 1,submain 2 ,submain 3 the ouput looks like that ,i would like to delete duplicate in each row at each attribute

 

 

Main

 

submain 1

 

submain 2

 

submain 3

 

5

 

2,5,4,4,3,3,4

 

6,6,3,2,2,5,1,5

 

9,4,7,8,2

 


Got ya.

 

In the example below I take the 1 record with 3 attributes, split by their delimiter, remove duplicates, re-concatenate, and then merge them back into a single record by their unique key.

 

Maybe someone else has an example of a regex that can do the same thing.

 

 


THANKS FOR UR method ,but in my case i do not have only one attribute and list concentae as u eplained i have tried ,i believe it is only to choose one attribute but at aaggregator ,i can choose more than attribute .

after i used the aggreator attribute to oncentate submain 1,submain 2 ,submain 3 the ouput looks like that ,i would like to delete duplicate in each row at eaach attribute

 

 

Main

 

submain 1

 

submain 2

 

submain 3

 

5

 

2,5,4,4,3,3,4

 

6,6,3,2,2,5,1,5

 

9,4,7,8,2

 

 

here it gives me relation between main and the another attribute ,in ur method can i get also relationship like here .so should i use two list duplicate remover for submain 1 and 2 or what should i do .

 

thanks

Got ya.

 

In the example below I take the 1 record with 3 attributes, split by their delimiter, remove duplicates, re-concatenate, and then merge them back into a single record by their unique key.

 

Maybe someone else has an example of a regex that can do the same thing.

 

 


Got ya.

 

In the example below I take the 1 record with 3 attributes, split by their delimiter, remove duplicates, re-concatenate, and then merge them back into a single record by their unique key.

 

Maybe someone else has an example of a regex that can do the same thing.

 

 

Thanks alot


Reply