I did a POC where I needed to:
1. Read information from an Excel spreadsheet and the insert this fields in certain tables in my postgres database tables.
This went fine once. But, when I repeat the process the same "n" numer of rows are inserted again. This is wrong since no change has occured.
2. After the first insert I need to update only the rows or fields that changed in that period. As I stated above, whenever I run the flow again and again more rows are inserted (indeed, the same rows are inserted).
Is there a way to arrange my model in a fashion that this requirement may be implemented? I mean. Insert once and update incrementally as needed?
If so, how? Is there any documentation about it?
Regards!