Question

How to read the columns name from a file into a list?


Badge

I need to read from a file with multiple records only the columns name that start with a prefix and convert them into a list to do some processing after with those column names. This is what I've got so far

This is the output with the column names that I need. But I need to convert those into a list to do some processing for every column name. How could I achieve that?

Thanks


3 replies

Badge +22

I would probably use a pythonCaller and the getAllAttributeNames() method.

Userlevel 2
Badge +17

Hi @rrdlpl, other than scripting, there are two possible ways to extract attribute names.

  • Explode a data feature with the AttributeExploder.
  • or, read the schema with the Schema (Any Format) reader to get "attribute{}.name" list.

[Addition] If you read the source dataset with a FeatureReader, schema features having "attribute{}.name" list will be output for each feature type via the <Schema> port, by default. The schema features are equivalent to the schema features read by the Schema (Any Format) reader.

Userlevel 4
Badge +25

To create a list I would use a Counter to create a unique ID (if you don't have one already) and an Aggregator transformer with group-by set to the ID. Make sure the "Generate List" option is set to yes (check the box). Then you should get the list you want.

Pity it doesn't allow a regular expression to define which attributes to add - then you could have checked for your prefix and created a list, all in one.

Reply