I want to retain the common fields, but I want to remove duplicates, but also flag the data sources.
So for Example I have:
Readers
File A
Name, Postcode, DOB
Bob, NG1 1AA, 01/01/1970
File B
Name, Postcode, DOB
John, SW1 1AA, 01/01/1980
Writers
File C
Name, Postcode, DOB, FileAFlag, FileBFlag
Bob, NG1 1AA, 01/01/1970, Yes, No
John, SW1 1AA, 01/01/1980, No, Yes
I can merge the File A and B , simply by using 2 AttributeCreators and 1 AttributeKeeper and a Writer.
------------------------------------------
The problem starts where I have duplicate entries and want to merge the data. See below:
Readers
File A
Name, Postcode, DOB
Bob, NG1 1AA, 01/01/1970
File B
Name, Postcode, DOB
Bob, NG1 1AA, 01/01/1970
Writers
File C
Name, Postcode, DOB, FileAFlag, FileBFlag
Bob, NG1 1AA, 01/01/1970, Yes, Yes
-------------------------------------------
Anyone know which transformers I need to use for this situation?
Thanks, S.
