Question

Dynamically converting datetime format from Oracle to BigQuery (SchemaScanner)

  • 24 May 2023
  • 0 replies
  • 6 views

Badge +1

Hello,

 

I'm trying to convert datetime format with SchemaScanner dynamically but I haven't been able to.

 

I have Oracle tables (thousands) and am trying to migrate the data to Google BigQuery.

Since it's nearly impossible to create an individual reader for each table and the corresponding writers, I'm using a dynamic Oracle reader and a dynamic BigQuery writer.

In the data migration process, I need to convert datatime from Oracle to a different format so that BigQuery can ingest the data.

 

When I was researching for an automated way to convert the datetime data, I came across the SchemaScanner transformer which in theory can detect datetime columns and convert the format dynamically.

 

I've tried to place a SchemaScanner between a dynamic reader and a dynamic writer but it doesn't seem to do anything.

In the "Date Handling" section of the SchemaScanner Parameters, I chose "Convert Input Date Format to FME Date" and I chose "Yes" for "Output Schema Before Data Features".

 

Any help would be appreciated.

Thanks.

 


0 replies

Be the first to reply!

Reply