I have created a workspace which has a prompt for user parameters, as I want the user to be able to run the workflow on different sets of data.
The workspace reads in a set of CSVs which have identical schema, performs some transformations and then writes the data out into a single CSV. The process works for what I want it to do.
The problem is when the prompt comes up to run and I choose a different set of CSVs, these CSVs have the same schema as each other but not the same schema as the previous set of data. The attributes that are used in the transformations are the same but other attributes are different and this data does not get read in. I want the reader to read in the new schema each time, but it always retains the schema from the first set of data I used to set up the reader.
How can I fix this?