Skip to main content
Question

Exclude records based on another dataset

  • July 31, 2014
  • 1 reply
  • 21 views

Good morning,

 

I am using SQL Creator to query a table in SQL Server. This table has about 45M records.

 

My VPN only stays connected for 24 hours, and my workspace needs more time to run.

 

 

Last night, I was up to 27M records written to text. In lieu of starting over, I was hoping there is a way to run the workspace again, but exclude the 27M records already written. There is a unique field in the table, so it would just be a matter of excluding based on that one field. I cannot figure out how to do this. I do have a list of the unique IDs that were already written in a MS Access database table.

 

 

Is there a transformer that would allow me to do this?

 

 

Thanks!

 

Erin

david_r
Evangelist
Hi,

 

 

you can use a FeatureMerger on the unique field. The features exiting "NotMerged" are the ones you haven't written yet.

 

 

David

Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings