Question

Dynamically define Attribute Definition based on input features on Fanout

  • 16 July 2020
  • 1 reply
  • 0 views

Badge +1

Hello, I am reading a number of input files that are then processed all-together and split into multiple subfiles based on an attribute, using fanout. The reason of running them together is that there are 30 inputs and each input generates 3 outputs, so that would be 90 writers in the workspace.

Fanout works fine. However, because each input has slightly different Attribute Definition, in the end the final outputs have an accumulation of all the attributes, most of them being empty.

I wanted to know if it is possible to take a different Attribute Definition for each input, if that makes sense? So each output after fanout would have exactly the attributes that it needs to have, and not lots of empty ones that come from the other files.

 

 


1 reply

Userlevel 5
Badge +25

You can set up a Dynamic writer and use the schema's of the input files to determine the schema of the output. Check out the Advanced Readers and Writers section of the Desktop Advanced training course.

Reply