Skip to main content
  • EN

Good morning,

I have a folder in an S3 bucket that contains a folder for each day of the year and each of those folders contain about 24 files. Since I need to download the data in order to process it, is there a way to only download the folders that contain the word “2025”?  I have not been able to format a wildcard that works for a folder. I could also potentially use a wildcard to select the files, if there is a way to do that.

Thank you,

Peter

You will need to use the List function of the S3Connector first, use a tester to filter the file containing the 2025 file and then Download the file that you need.

I share the opinion of ​@carlm, you should use the option Include subfolders = No to only read the first level, i.e. the folder names, then filter (e.g Tester) before reading the individual folder contents.

Excellent, thank you @david_r and @carlm for the quick responses.  This worked perfectly and now I don’t fill up my local drive!  I wish I could select both as the Best Answer.  

Community Stats

31,788
Posts
120,752
Replies
39,405
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.