I used S3Connector to upload a file to a S3 bucket which has versioning enabled. I uploaded three files to the same bucket, and I can see the three version IDs in the AWS console. Can I retrieve the version ID of the latest upload? Can I download the file of a specific version?
Solved
Can FME read AWS S3 file version ID?
+10- Contributor
Best answer by aguan
aguan wrote:
@nampreetatsaft, yet I just voted for this idea post. I have a python script that can retrieve the version, will try using PythonCaller, and maybe HTMLCaller. Thanks for the help.
Using boto3 python module, which fortunately comes with FME, I successfully retrieved S3 version ID in a PythonCaller.
+12- Safer
Hi @aguan: Great question! I don't see way of currently doing this using the S3Connector. I've created this Idea post for you, which I would encourage you to vote on and provide a comment on to tell us more about your use-case.
If you enable versioning in your S3 Bucket, and upload an object multiple times using the S3Connector, it does seem to create a new version. But unfortunately the S3Connector isn't brining in the versioning information when doing a listing or download.
In the meantime, consider try the HTMLCaller to leverage the S3 API: https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListObjectVersions.html
+10- Contributor
nampreetatsafe wrote:
Hi @aguan: Great question! I don't see way of currently doing this using the S3Connector. I've created this Idea post for you, which I would encourage you to vote on and provide a comment on to tell us more about your use-case.
If you enable versioning in your S3 Bucket, and upload an object multiple times using the S3Connector, it does seem to create a new version. But unfortunately the S3Connector isn't brining in the versioning information when doing a listing or download.
In the meantime, consider try the HTMLCaller to leverage the S3 API: https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListObjectVersions.html
@nampreetatsaft, yet I just voted for this idea post. I have a python script that can retrieve the version, will try using PythonCaller, and maybe HTMLCaller. Thanks for the help.
+10- Contributor
- Best Answer
aguan wrote:
@nampreetatsaft, yet I just voted for this idea post. I have a python script that can retrieve the version, will try using PythonCaller, and maybe HTMLCaller. Thanks for the help.
Using boto3 python module, which fortunately comes with FME, I successfully retrieved S3 version ID in a PythonCaller.
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.