Skip to main content
Archived

'Input is Ordered by Fanout Expression' for Dataset Fanout

Related products:Transformers
  • August 25, 2016
  • 2 replies
  • 55 views

takashi
Celebrity

Fanout Dataset is a great mechanism, but it could consume huge temporary disk space. Similar to the 'Input is Ordered by Group' option for Group By setting in transformers, it might be better if Fanout Dataset (writers and FeatureWriter) could have 'Input is Ordered by Fanout Expression' option so that the processing could be more efficiently in some cases.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

Forum|alt.badge.img+5
  • August 25, 2016

I posted a similar idea a bit ago, also after running into the large memory usage. Still want to see it happen, so I'll give it another upvote!


jdh
Contributor
Forum|alt.badge.img+40
  • Contributor
  • February 15, 2017

Just ran into another situation where this would have been very helpful.