Skip to main content
Solved

Dynamic Update Detector

  • December 19, 2018
  • 3 replies
  • 13 views

oliver.morris
Contributor
Forum|alt.badge.img+12

Hi, I was wondering if anyone has created a dynamic update detector. Ideally where you pass the original table, revised table, key attribute and attributes to match as parameters to a workspace or custom transformer.

something along the lines of:

At the moment I would need to have all the tables dynamically popualted along with the key attribute and attributes to match. This is because when I tried to do it with defined tables I run out of memory, so it would be more ideal to do it one at a time. This could then be super reusable in all code.

 

Many Thanks for any help or pointers.

 

Oliver

Best answer by markatsafe

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)

View original
Did this help you find an answer to your question?

3 replies

Forum|alt.badge.img+2
  • Best Answer
  • December 20, 2018

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)


oliver.morris
Contributor
Forum|alt.badge.img+12
  • Author
  • Contributor
  • December 21, 2018
markatsafe wrote:

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)

Thanks Mark, I have tried to make it dynamic but alas I am not getting much further, please check out the template file, I can pass the list and the matching field but it doesnt seem to match them correctly. My only other thought it to parameterise them all then just use a workspace runner?

Thanks for any guidance you may have. The issue is I cant run this for all tables because the memory simply fills up and then fails, I need to do it one at a time. At the moment I simply truncate and populate the table but this is not that smart especially when the sql jdbc reader/writer for sql server is so slow.

Many Thanks reworked auto detector.fmwt

Oliver


oliver.morris
Contributor
Forum|alt.badge.img+12
  • Author
  • Contributor
  • January 2, 2019
markatsafe wrote:

We've re-engineered UpdateDetector in FME 2019. It has been merged into the ChangeDetector and it is no longer a custom transformer but a fully fledged member of the transformer community. You can download FME 2019 betas from here if you want to give it a try. You can wrap the new ChangeDetector/UpdateDetector in a custom transformer to add a group by so each set of features could be grouped as described in this article.

(at the time of writing there are still some interface layout changes to be made on the new ChangeDetector/UpdateDetector to make it easier to use)

thanks @MarkAtSafe if we can have something more along the lines of merge - https://docs.microsoft.com/en-us/sql/t-sql/statements/merge-transact-sql?view=sql-server-2017 that would be amazing, look forward to checking out the amendments in 2019.


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings