Skip to main content
Good morning,

 

I am using SQL Creator to query a table in SQL Server. This table has about 45M records.

 

My VPN only stays connected for 24 hours, and my workspace needs more time to run.

 

 

Last night, I was up to 27M records written to text. In lieu of starting over, I was hoping there is a way to run the workspace again, but exclude the 27M records already written. There is a unique field in the table, so it would just be a matter of excluding based on that one field. I cannot figure out how to do this. I do have a list of the unique IDs that were already written in a MS Access database table.

 

 

Is there a transformer that would allow me to do this?

 

 

Thanks!

 

Erin
Hi,

 

 

you can use a FeatureMerger on the unique field. The features exiting "NotMerged" are the ones you haven't written yet.

 

 

David

Reply