Skip to main content
  • EN

I have an interesting dilemma and was hoping to get an idea of how FME peoples would approach it. I have an Oracle 12c DW with multiple data sources being loaded into it (FME is handling these well so far). However I have a data source with some interesting restrictions...it is a MSSQL 2008 data source that (for a variety of reasons) I can't directly connect to and the only manner in which I can get this data is via it's scheduled backups. Backups are done as a weekly full backup and incremental backups for each day until the next full weekly backup.

As far as I'm aware, FME is unable to read these backups directly (please correct me if I'm wrong there) and I would have to restore these backups to an intermediate MSSQL server and then I can connect to that using FME as I have for the other data sources. This incurs a cost (sql server license and hardware) that I'm not entirely sure if my client is willing to absorb. Are there any other viable techniques I can use here?

**There is no spatial data here fortunately, just transaction rows. Decent volume but not huge, around 35gb of data (350m rows)

I have no first hand experience with SQLServer backup files, but the thought of reading a database backup file outside the database infrastructure gives me a bad vibe. Incremental backups even more so.

Would it be possible to ask your client to dump the table as e.g. a CSV while they do their nightly backups? That would make it a lot easier to deal with.

Some ideas here: https://stackoverflow.com/a/14266993

+1 to what @david_r said, see if you can get them to provide a CSV dump and read that.

Reply


Community Stats

30,102
Posts
114,260
Replies
37,733
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.