Hi. I am using the Aggregator transformer to summarise some tabular data by a reference (there may be multiple records originally for each reference). I am merging the attributes and concatenating some attributes.
This is technically doing exactly what I want but with nearly 1m records, it is very slow. I know there are usually multiple ways to achieve something in FME so I wondered there an alternative to the Aggregator to do what I need?
Many thanks
Thanks
You could try using a few list transformers: listbuilder (groupby), listconcatenator, listhistogrammer, etc. Not sure if that would be any faster though.
I initially jumped straight to statisticsCalculator, but because you're wanting to concatenate attrs that wont work.
You could look at python, that may offer some speed improvements.
Assuming that your aggregator will be using groupby, you could embed the aggregator in a custom transformer. Then set the custom transformer to groupby the same attribute and enable parallel processing.