I used S3Connector to upload a file to a S3 bucket which has versioning enabled. I uploaded three files to the same bucket, and I can see the three version IDs in the AWS console. Can I retrieve the version ID of the latest upload? Can I download the file of a specific version?
Solved
Can FME read AWS S3 file version ID?
+11- Supporter
Best answer by aguan
@nampreetatsaft, yet I just voted for this idea post. I have a python script that can retrieve the version, will try using PythonCaller, and maybe HTMLCaller. Thanks for the help.
Using boto3 python module, which fortunately comes with FME, I successfully retrieved S3 version ID in a PythonCaller.
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
+13- Safer
Hi @aguan: Great question! I don't see way of currently doing this using the S3Connector. I've created this Idea post for you, which I would encourage you to vote on and provide a comment on to tell us more about your use-case.
If you enable versioning in your S3 Bucket, and upload an object multiple times using the S3Connector, it does seem to create a new version. But unfortunately the S3Connector isn't brining in the versioning information when doing a listing or download.
In the meantime, consider try the HTMLCaller to leverage the S3 API: https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListObjectVersions.html
+11- Supporter
Hi @aguan: Great question! I don't see way of currently doing this using the S3Connector. I've created this Idea post for you, which I would encourage you to vote on and provide a comment on to tell us more about your use-case.
If you enable versioning in your S3 Bucket, and upload an object multiple times using the S3Connector, it does seem to create a new version. But unfortunately the S3Connector isn't brining in the versioning information when doing a listing or download.
In the meantime, consider try the HTMLCaller to leverage the S3 API: https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListObjectVersions.html
@nampreetatsaft, yet I just voted for this idea post. I have a python script that can retrieve the version, will try using PythonCaller, and maybe HTMLCaller. Thanks for the help.
+11- Supporter
- Best Answer
@nampreetatsaft, yet I just voted for this idea post. I have a python script that can retrieve the version, will try using PythonCaller, and maybe HTMLCaller. Thanks for the help.
Using boto3 python module, which fortunately comes with FME, I successfully retrieved S3 version ID in a PythonCaller.