Skip to main content
Solved

Dynamic Update Detector

  • December 19, 2018
  • 3 replies
  • 19 views
oliver.morris
Contributor
Forum|alt.badge.img+14

Hi, I was wondering if anyone has created a dynamic update detector. Ideally where you pass the original table, revised table, key attribute and attributes to match as parameters to a workspace or custom transformer.

something along the lines of:

At the moment I would need to have all the tables dynamically popualted along with the key attribute and attributes to match. This is because when I tried to do it with defined tables I run out of memory, so it would be more ideal to do it one at a time. This could then be super reusable in all code.

 

Many Thanks for any help or pointers.

 

Oliver

Best answer by markatsafe

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

3 replies

M
Forum|alt.badge.img+2
  • markatsafe
  • 1891 replies
  • Best Answer
  • December 20, 2018

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)

oliver.morris
Contributor
Forum|alt.badge.img+14
  • oliver.morrisContributor
  • Author
  • Contributor
  • 176 replies
  • December 21, 2018

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)

Thanks Mark, I have tried to make it dynamic but alas I am not getting much further, please check out the template file, I can pass the list and the matching field but it doesnt seem to match them correctly. My only other thought it to parameterise them all then just use a workspace runner?

Thanks for any guidance you may have. The issue is I cant run this for all tables because the memory simply fills up and then fails, I need to do it one at a time. At the moment I simply truncate and populate the table but this is not that smart especially when the sql jdbc reader/writer for sql server is so slow.

Many Thanks reworked auto detector.fmwt

Oliver

oliver.morris
Contributor
Forum|alt.badge.img+14
  • oliver.morrisContributor
  • Author
  • Contributor
  • 176 replies
  • January 2, 2019

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)

thanks @MarkAtSafe if we can have something more along the lines of merge - https://docs.microsoft.com/en-us/sql/t-sql/statements/merge-transact-sql?view=sql-server-2017 that would be amazing, look forward to checking out the amendments in 2019.

Community Stats

32,058
Posts
121,723
Replies
39,686
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.