Skip to main content
  • EN

I have a newbie question.

 

Can I instruct FME that I wish it to finish all previous steps (transformers), before proceeding with the next step?

 

By way of example I have a workbench that gets a list of files from FTP, downloads those that match a regex pattern (might be a few hundred mb), unzips them, and then needs to call a SystemCaller for some custom code to run. I need all the FTP files to be downloaded, and all the files to be unzipped before I run the next bit of code. FME wants to slide each file right the way through the workflow individual of each other. So, I might wind up collecting 10 files before I can run the SystemCaller, but I do need the 10 files present.

 

Something along the lines of "If there's 10 things on the input side, you need 10 things on the output side before proceeding".

One way to do this is to use the Sampler transformer.

Connect the outputports from the transformers you want to wait for to the Sampler and set the parameters of the Sampler to Last N Features, Sampling Rate 1.

In earlier times I used a FeatureHolder and a Sampler, but now you can choose to release the last feature the FeatureHolder is not needed anymore.

Thanks - any need to use the "group by" function, or just Last N Features and Sample Rate as 1?

Thanks - any need to use the "group by" function, or just Last N Features and Sample Rate as 1?

Nope, group by not needed. I think you only want one feature to initiate the next step. If you try to process multiple batches as one, you might need the group by but I suspect this is not the case.

Nope, group by not needed. I think you only want one feature to initiate the next step. If you try to process multiple batches as one, you might need the group by but I suspect this is not the case.

Golden. Worked a treat. Thank you!

Reply


Community Stats

30,418
Posts
115,551
Replies
38,228
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.