Skip to main content
  • EN
Good morning,

 

I am using SQL Creator to query a table in SQL Server. This table has about 45M records.

 

My VPN only stays connected for 24 hours, and my workspace needs more time to run.

 

 

Last night, I was up to 27M records written to text. In lieu of starting over, I was hoping there is a way to run the workspace again, but exclude the 27M records already written. There is a unique field in the table, so it would just be a matter of excluding based on that one field. I cannot figure out how to do this. I do have a list of the unique IDs that were already written in a MS Access database table.

 

 

Is there a transformer that would allow me to do this?

 

 

Thanks!

 

Erin
Hi,

 

 

you can use a FeatureMerger on the unique field. The features exiting "NotMerged" are the ones you haven't written yet.

 

 

David

Reply


Community Stats

30,108
Posts
114,295
Replies
37,743
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.