Skip to main content
Released

Rerun from saved intermediate results via 'Storage Point' concept

Related products:FME Form
  • February 16, 2016
  • 5 replies
  • 69 views
R

Imagine when you have huge amount of input data and long list of transfmormers,

And after making few small changes in the last transfromer, you have to wait a long time to run through all the previoius transformers to verify the changes of the last transfomer.

I propose to add a new function called 'Storage Point' where FME can save the intermediate data passing through this point.

Next time user run the workspace, there should be an option to 'Run From Storage Point ' which restore the data from 'Storage Point', begin running transmformation after 'Storage Point'.

This time it might take 10s to verify my changes to the last transformer.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

5 replies

david_r
Celebrity
  • david_rCelebrity
  • February 16, 2016

You can already simulate this today by using the Recorder and the Player transformer, although I admit your suggestion sounds smoother.

fmelizard
Safer
Forum|alt.badge.img+22
  • fmelizardSafer
  • Safer
  • February 17, 2016

We've kicked this idea around before too. We already are close -- Run With Full Inspection effectively does this. We just can't "restart" the transformation. So long as y'all have lots of disk space, there isn't really a huge technical problem to do this. Let the voting begin!

fmelizard
Safer
Forum|alt.badge.img+22
  • fmelizardSafer
  • Safer
  • March 30, 2017

Adding a "Break Point" would allow running the data to that point. Then the user could manipulate transformers downstream of the breakpoint without having to re-load the data above the breakpoint. It would be elegant if this worked the same way as breakpoints work in Visual Studio code.

redgeographics
VIP
Forum|alt.badge.img+63

Looks very similar to this idea, perhaps the two can be merged?

FME rocks! \m/
fmelizard
Safer
Forum|alt.badge.img+22
  • fmelizardSafer
  • Safer
  • January 31, 2018

Hi @roger7467, this has been implemented in our 2018 Betas as partial runs. You can use partial runs to run part of a workspace, mid-way through a workspace, or run up to a certain transformer. You'll have to turn on "Run with Full Inspection" to enable this.

'

Please note that this is a beta feature and its functionality and appearance are subject to change as the product continues to evolve before the official release. Should this feature or its implementation not address your concerns, related to this Idea posting, please let us know by leaving a comment.

As with all beta features and beta versions of our software, they are not considered production-safe and should be incorporated into your workflows with consideration and testing.

Community Stats

32,749
Posts
124,195
Replies
41,251
Members
Terms & ConditionsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.