Question

How to migrate data in different slots setting parameters within the Reader itself ?

  • 16 August 2022
  • 3 replies
  • 0 views

I have the Geodatabase data with around 40 milions of records in it with huge size but want read this data in parts like 1 to 10000000 , next adding it to next slot 10000001 to 20000000 to get it written in SQL database. In reader, geodatabase i have Object ID as one field with count to follow as per records.

How it can be acheived with giving parameters in reader itself with different slots creating to migrate the data in different FME workbences as per slots.


3 replies

can anybody help me on this above issue

 

Userlevel 3
Badge +33

You can add a Where-clause to the reader.

ObjectID >= 10000001 and ObjectID <= 20000000

 

Userlevel 3
Badge +33

Or you can replace the reader with an SQLCreator (or a Creator followed by an SQLExecutor). See this article for more information.

"If all the data to be queried already exists in a SQL-capable data source, it is generally most efficient to use the SQLCreator or SQLExecutor, as the queries and filtering of the data is executed directly by the database before it enters the FME environment."

Reply