How can I control the flow of features when I have multiple flows of data in one workspace?
Best answer by fmelizard
View original
Control the flow of features in a workspace
Userlevel 4
+13
- Contributor
- 3701 replies
-
21 September 2016
- Best Answer
The Sampler coupled with a blocking transformer can be used to control the flow of features inthe workspace, when there are multiple flows of data in one workspace.
Sampler and blocking transformer control flow of features
A Sampler, with Sampling Amount set to 0, canbe used to control the order of data processing in the workspace. After the Sampler, place a blockingtransformer such as the FeatureHolder, FeatureMerger, or any other blocking ansformerwhich waits until all features have been received before processing. Route features from before the Sampler (orother features in the workspace) and Sampler output to the blocking transformer. TheSampler creates dependency between transformers. The blocking transformer will not finish processinguntil all features from the other branch of the workspace have finishedprocessing.
Sample workspace: controlflowusingthesampler.fmwt
The Sampler coupled with a blocking transformer can be used to control the flow of features inthe workspace, when there are multiple flows of data in one workspace.
Sampler and blocking transformer control flow of features
A Sampler, with Sampling Amount set to 0, canbe used to control the order of data processing in the workspace. After the Sampler, place a blockingtransformer such as the FeatureHolder, FeatureMerger, or any other blocking ansformerwhich waits until all features have been received before processing. Route features from before the Sampler (orother features in the workspace) and Sampler output to the blocking transformer. TheSampler creates dependency between transformers. The blocking transformer will not finish processinguntil all features from the other branch of the workspace have finishedprocessing.
Sample workspace: controlflowusingthesampler.fmwt
The Sampler coupled with a blocking transformer can be used to control the flow of features inthe workspace, when there are multiple flows of data in one workspace.
Sampler and blocking transformer control flow of features
A Sampler, with Sampling Amount set to 0, canbe used to control the order of data processing in the workspace. After the Sampler, place a blockingtransformer such as the FeatureHolder, FeatureMerger, or any other blocking ansformerwhich waits until all features have been received before processing. Route features from before the Sampler (orother features in the workspace) and Sampler output to the blocking transformer. TheSampler creates dependency between transformers. The blocking transformer will not finish processinguntil all features from the other branch of the workspace have finishedprocessing.
Sample workspace: controlflowusingthesampler.fmwt
Maybe this can be useful. You can do several transformations over features in parallel and join the results with an Aggregator transformer. In case you have more than one original features, you can use the "Group by" parameter.
I've often thought it would be useful to have the transformer equivalent of an electronic transistor. Use one set of features to control another set. Or the end of a stream to trigger the start of another stream.
Userlevel 2
+17
- Contributor
- 7538 replies
-
26 June 2017
I've often thought it would be useful to have the transformer equivalent of an electronic transistor. Use one set of features to control another set. Or the end of a stream to trigger the start of another stream.
Reply
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.