Hi,
Is it possible to call the s3Uploader transformer using a python shutdown script? My workflow currently uses a python shutdown script to convert the FME output data into a number of proprietary formats and now I would like to upload these proprietary files to AWS S3. I would preferred to do it all using a single work bench without install extra python modules(ie Boto3)
Thanks
Best answer by takashi
Hi @aaronthorn, I don't think it's possible. There are two workarounds:
[A] Create another worksapce, which contains a WorkspaceRunner (Wait for Job to Complete: Yes) to run the current workspace and a S3Uploader to upload the resulting dataset(s) to S3. If the workspace will be run with FME Server, use the FMEServerJobSubmitter instead of the WorkspaceRunner.
or
[B] Replace all the writer(s) in the current workspace with FeatureWriter transforme(s) and add S3Uploader(s), which uploads resulting dataset(s) to S3 after writing completed.
Hi @aaronthorn, I don't think it's possible. There are two workarounds:
[A] Create another worksapce, which contains a WorkspaceRunner (Wait for Job to Complete: Yes) to run the current workspace and a S3Uploader to upload the resulting dataset(s) to S3. If the workspace will be run with FME Server, use the FMEServerJobSubmitter instead of the WorkspaceRunner.
or
[B] Replace all the writer(s) in the current workspace with FeatureWriter transforme(s) and add S3Uploader(s), which uploads resulting dataset(s) to S3 after writing completed.
Hi @aaronthorn, I don't think it's possible. There are two workarounds:
[A] Create another worksapce, which contains a WorkspaceRunner (Wait for Job to Complete: Yes) to run the current workspace and a S3Uploader to upload the resulting dataset(s) to S3. If the workspace will be run with FME Server, use the FMEServerJobSubmitter instead of the WorkspaceRunner.
or
[B] Replace all the writer(s) in the current workspace with FeatureWriter transforme(s) and add S3Uploader(s), which uploads resulting dataset(s) to S3 after writing completed.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
