Hi everyone,
I’m encountering an issue with the migration of Smallworld collection records to MSSQL using FME. I perform a differential migration of Smallworld records daily, and I need a way to identify and log any failed records during this process.
In a previous migration project, I handled this situation using a post-validation Magik script, which compared the migrated objects in the external database. This database had a version control mechanism managed by an additional date column, making it easy to track if records were inserted, updated, or deleted.
However, in the current case, there is no such versioning column in the MSSQL database, making it challenging to track failed records.
I’ve decided to log the failed records directly in FME. After exploring various resources, most suggestions point to using the Logger transformer, custom transformers, or Python scripts to read the FME log file for errors. While these methods help identify general errors, they don’t provide details about the specific Smallworld record ID that caused the failure.
I’m looking for a way to log or capture the exact record details (e.g., record ID) of the failed features directly in FME. Any suggestions or best practices to achieve this would be greatly appreciated!
Thank you in advance!