Re this question:
https://knowledge.safe.com/questions/33126/validateread-export-thousand-of-txt-to-csv-txt-are.html
I'm thinking it would be pretty useful if lines in a CSV (or text file) could be skipped depending on a particular test; for example it begins with a line with a comment character like
So, to that end I suggest adding the Tester transformer behaviour into the CSV parameters dialog, like this mockup:
+28I would use this, moreso in the text file reader than the CSV.
A lot of times the header is a comment and can be variable length.
An option to skip empty lines would also be nice.
+17And in the Excel reader, where having multiple (concatenated) header lines could be filtered out.
In FME 2016 and earlier the CSV reader does have Filter by Field Value - at the bottom of the Parameters dialog. This uses regular expressions to allow you to filter records during the read. Is this not sufficient?
Revisions to the FME 2017 (available in beta) improve the performance of the CSV reader so that using the Tester for filtering should be sufficient.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
