Solved

Updating data using incremental Updates

  • 10 July 2020
  • 1 reply
  • 11 views
G
Badge +3

I am trying to set up a process where I have a bulk dataset of approximately 77,000 records and will be needing to do weekly updates. The first incremental update had 48 records so I am trying to do UPDATE, INSERT, DELETE of these to my bulk dataset with 77,000 records. I have set up a process that looks like this. How do I compare the records before I write it out though and is this the best way to do it but can't seem to get this process to work using change detector. When I looked at the bulk record it had only added 12 records but thought I would get 13 extra records based on my workbench.

icon

Best answer by markatsafe 10 July 2020, 22:31

View original

1 reply

M
Badge +2

@gisgeek Does your CSV file already have an update type (insert, update, delete)? if it does, then what it looks like you're doing in the image should work.

In the AttributeCreator set fme_db_operation to be INSERT|UPDATE|DELETE and on the writer feature type set Feature Operation: fme_db_operation and set the Match Columns attributes (keys). More details in the FME Documentation and this tutorial

You shouldn't need the ChangeDetector if your input data has the update flags (insert,update,delete)

If it's still not working, share a small sample dataset.

Reply


Community Stats

28,684
Posts
109,411
Replies
36,542
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.