Skip to main content
Solved

I'm trying to connect to a non Amazon hosted S3 Service. Is that possible using the S3Downloader Transformer


Forum|alt.badge.img

Thinking other cloud providers provide S3 compatible storage. In this specific case we have an on prem S3 Storage device. I'd like to be able to pull the data from a bucket on that device. With most other tools I can override the hosts that the s3 protocol is trying to connect to. It doesn't look like that's the case for the fme s3 downloader, or am I missing something.

Best answer by jlutherthomas

@guy_lafleur​ 

I wrote this article about minIO and FME a while back, which worked as long as you change the endpoint.

https://community.safe.com/s/article/MinIO-and-FME

View original
Did this help you find an answer to your question?

4 replies

redgeographics
Celebrity
Forum|alt.badge.img+49

The S3Connector works with Amazon S3, if that other service is identical to S3 (which is not the same as compatible) it might work, but since you're having trouble I'm assuming it works differently in terms of authentication and/or api calls


Forum|alt.badge.img

Thanks for the answer.... It looks like S3 communication is via a rest api. I think other S3 Compatible providers just implement that api (example minio). There are a few tools out there that allow you to browse your s3 storage (S3-browser, cyberduck, etc). All those tools allow you to override default server/host values with the name of whatever host your s3 service is running on. It seemed odd that this wasn't the case with the various FME S3 transformers, thus the question, as I felt like maybe I was missing something...


hkingsbury
Celebrity
Forum|alt.badge.img+54
  • Celebrity
  • March 6, 2022

It should be relatively straight forward to achieve the same outcomes using httpcallers and the services api documentation


Forum|alt.badge.img+2

@guy_lafleur​ 

I wrote this article about minIO and FME a while back, which worked as long as you change the endpoint.

https://community.safe.com/s/article/MinIO-and-FME


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings