Skip to main content
Solved

Connecting to Elasticsearch on AWS


oliver.morris
Contributor
Forum|alt.badge.img+12

Thanks for your help and suggestions in advance. I am using Elasticsearch service on AWS the default port for it is 443 not 9200.

 

Unfortunately FME seems to keep wanting to put 9200 at the end and then reporting it cannot reach the service:

 

ELASTICSEARCH writer: Opening index 'https://search-web-elasticsearch-4vxxxxpx2.eu-central-1.es.amazonaws.com/webmapnotes'

ELASTICSEARCH writer: Failed to connect to search-web-elasticsearch-4v3o3xxxpx2znima.eu-central-1.es.amazonaws.com port 9200: Timed out

ELASTICSEARCH writer: Unable to locate or open server 'https://search-web-elasticsearch-4v3xxxznima.eu-central-1.es.amazonaws.com'. Please ensure the server exists and is accessible. 

 

In the writer I put the port https://search-web-elasticsearch-4vxxxxznima.eu-central-1.es.amazonaws.com:443

 

That doesn't seem to work. Any idea how I can change the port away from the default.

 

Many Thanks

 

Oliver

Best answer by david_r

Are you sure it's not (partially) a question of ES versions? As far as I know, FME doesn't support ES 7+, which is what I suspect AWS is provisioning by default. That might be something to verify.

See also https://community.safe.com/s/idea/0874Q000000Tki3QAC/detail

In case you need to use ES 7+, it's not too complicated to do manually using some JSONTemplaters and HTTPCallers.

View original
Did this help you find an answer to your question?

2 replies

david_r
Evangelist
  • Best Answer
  • February 2, 2021

Are you sure it's not (partially) a question of ES versions? As far as I know, FME doesn't support ES 7+, which is what I suspect AWS is provisioning by default. That might be something to verify.

See also https://community.safe.com/s/idea/0874Q000000Tki3QAC/detail

In case you need to use ES 7+, it's not too complicated to do manually using some JSONTemplaters and HTTPCallers.


oliver.morris
Contributor
Forum|alt.badge.img+12
  • Author
  • Contributor
  • February 3, 2021
david_r wrote:

Are you sure it's not (partially) a question of ES versions? As far as I know, FME doesn't support ES 7+, which is what I suspect AWS is provisioning by default. That might be something to verify.

See also https://community.safe.com/s/idea/0874Q000000Tki3QAC/detail

In case you need to use ES 7+, it's not too complicated to do manually using some JSONTemplaters and HTTPCallers.

Thanks, I am using ES 6 to avoid those issues. Previously it was on 80 but now it is on 443 and it looks like the writer doesn't like it. I may have to go down the HTTPCaller route. Thank you


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings