Skip to main content
Question

How to manage input order ?


Forum|alt.badge.img
I've got a workbench which look like this:

 

 

  Reader --> T1 ---------->Aggregator -> Writer

 

                 |              |

 

                 -> CT1 -|

 

                 -> CT2 -|

 

 

Every feature has an "id" and the aggregator groupd them with the "id"

 

 

T1 is a simple transformer (like AttributeCreator).

 

CT1 and CT2 are custom transformer very complicated with many steps (~20 each without the same length).

 

 

Because i've got ~1million element in the Reader, in the Aggregator I which I could select the "Input is ordered by group" for "performance" issues.

 

But it does not work; I've got only the T1 output.

 

 

So, How may I do this ?

 

 

For feeding the pipe I though of "no-op" block like in electronic ... but it's does not exist and it's a pain to do.. and not very reliable.

 

 

Is there something else I could do / use ?

 

 

 

 

 

2 replies

gio
Contributor
Forum|alt.badge.img+15
  • Contributor
  • April 3, 2014
Hi,

 

 

If every item has an (unique)ID then grouping on that ID is not very usefull for perfomance gain.

 

 

If u want the gain and the ability to use paralel processing you should create some grouping strategy.

 

U could use a gridbuilder, or a tiler strait at the beginning of the bench. I usualy use ie neighborhoodnames or create some grid. Teh attributes must be passed all trough the processing. Alos take care to keep the correct instances of these "group_D's"

 

 

This also fascilitates paralell processing.

 

Greets

 

Gio

Forum|alt.badge.img
  • Author
  • April 4, 2014
You're right: it's not very useful for performance, but it's mendatory for database insertion.

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings