I am trying to read in multiple files from a folder at once which contain a specific text string in the title and not any files that don't contain that string. I want it to be dynamic, such that if the files in the folder change, the reader will update as I want to put this at the start of a workflow which will put all the features from each individual source file into a single file and perform some transformations with that data. I have managed to figure out making a reader that looks at a folder and all its sub folders, but it reads in all the files in the folder, some of which I don't need/want. Is there a way I can apply a search filter to the reader so it only brings in files that have certain terms in the title?
Solved
read multiple files from a folder that all contain a specific text string in the title
Best answer by ebygomm
ocarey wrote:
Sorry for my ignorance I've only just started using FME. How would I know which reader I am using? I am just using the "add reader" function in the workbench. I am using Mapinfo Tab as the format and the dataset is a folder on my server which I am selecting using the "select multiple folders/files" option and I am including all sub folders as the files are split up into sub folders. I'm using "single Merged Feature type" for the workflow option.
No problem, if you are reading mapinfo files you are using a mapinfo reader. If you have added it and chosen a folder it should have created a published parameter called something like SourceDataset_MAPINFO
This will look something like
C:\folders\myfolder\*.tabIf you want it for example to only read tab files that contain the word test you could amend to
C:\folders\myfolder\*test*.tab
+32- Influencer
What reader are you using? You can use wildcards in the path to only include files that contain certain terms
Sorry for my ignorance I've only just started using FME. How would I know which reader I am using? I am just using the "add reader" function in the workbench. I am using Mapinfo Tab as the format and the dataset is a folder on my server which I am selecting using the "select multiple folders/files" option and I am including all sub folders as the files are split up into sub folders. I'm using "single Merged Feature type" for the workflow option.
+32- Influencer
- Best Answer
ocarey wrote:
Sorry for my ignorance I've only just started using FME. How would I know which reader I am using? I am just using the "add reader" function in the workbench. I am using Mapinfo Tab as the format and the dataset is a folder on my server which I am selecting using the "select multiple folders/files" option and I am including all sub folders as the files are split up into sub folders. I'm using "single Merged Feature type" for the workflow option.
No problem, if you are reading mapinfo files you are using a mapinfo reader. If you have added it and chosen a folder it should have created a published parameter called something like SourceDataset_MAPINFO
This will look something like
C:\folders\myfolder\*.tabIf you want it for example to only read tab files that contain the word test you could amend to
C:\folders\myfolder\*test*.tab
ebygomm wrote:
No problem, if you are reading mapinfo files you are using a mapinfo reader. If you have added it and chosen a folder it should have created a published parameter called something like SourceDataset_MAPINFO
This will look something like
C:\folders\myfolder\*.tabIf you want it for example to only read tab files that contain the word test you could amend to
C:\folders\myfolder\*test*.tab
Thanks this has done the trick. Just for reference, since I am also using sub folders the path ended up looking like:
C:\folders\myfolder\**\*test*.tab
Reply
Rich Text Editor, editor1
Editor toolbars
Press ALT 0 for help
Helpful Members This Week
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.