Skip to main content
Question

How to manage input order ?

  • April 3, 2014
  • 2 replies
  • 96 views

Forum|alt.badge.img
I've got a workbench which look like this:

 

 

  Reader --> T1 ---------->Aggregator -> Writer

 

                 |              |

 

                 -> CT1 -|

 

                 -> CT2 -|

 

 

Every feature has an "id" and the aggregator groupd them with the "id"

 

 

T1 is a simple transformer (like AttributeCreator).

 

CT1 and CT2 are custom transformer very complicated with many steps (~20 each without the same length).

 

 

Because i've got ~1million element in the Reader, in the Aggregator I which I could select the "Input is ordered by group" for "performance" issues.

 

But it does not work; I've got only the T1 output.

 

 

So, How may I do this ?

 

 

For feeding the pipe I though of "no-op" block like in electronic ... but it's does not exist and it's a pain to do.. and not very reliable.

 

 

Is there something else I could do / use ?

 

 

 

 

 
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

gio
Contributor
Forum|alt.badge.img+15
  • Contributor
  • April 3, 2014
Hi,

 

 

If every item has an (unique)ID then grouping on that ID is not very usefull for perfomance gain.

 

 

If u want the gain and the ability to use paralel processing you should create some grouping strategy.

 

U could use a gridbuilder, or a tiler strait at the beginning of the bench. I usualy use ie neighborhoodnames or create some grid. Teh attributes must be passed all trough the processing. Alos take care to keep the correct instances of these "group_D's"

 

 

This also fascilitates paralell processing.

 

Greets

 

Gio

Forum|alt.badge.img
  • Author
  • April 4, 2014
You're right: it's not very useful for performance, but it's mendatory for database insertion.