Skip to main content
Question

Best practices for monitoring folder of XML files and then uploading new ones to S3?

  • July 24, 2018
  • 1 reply
  • 12 views
E

I have a folder that has approximately 50 XML files in it. Between one and three new XML files are added to the folder each day. Each of these files needs to be sent to an AWS S3 bucket. Ideally, every morning FME would scan the folder for new XML files and upload only the new files to the S3 bucket.

 

 

Does anyone have an example workspace or best pracitces they can share? There seems to be many ways to do this, but I would love some guidance on the most efficient and reliable route.

I have both FME Desktop and FME Server.

Thanks!!

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

stalknecht
Contributor
Forum|alt.badge.img+22
  • stalknechtContributor
  • Contributor
  • July 25, 2018

In general you can use the next steps. Create a workspace that copies a XML file to S3 using S3Uploader transformer and publish it to server. On FME server add a publication with the protocol "Directory Watch" to point to the XML folder. Create a topic to publish to. Create a subscription that listens to the same topic with protocol "FME Workspace" and call the just created workspace to do the trick.

Community Stats

32,207
Posts
122,305
Replies
39,891
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.