I am wondering if someone can share your experience of pulling certain fme server logs into an elasticsearch database and using Kibana to monitor / analyse the activities in the logs.
+8- Contributor
Hi @bo,
I have done some testing year ago using Elasticsearch 2.2.0, Logstach 2.2.0 and Kibana 4.4.0.
The process may be changed slightly with new version of Elasticsearch. Anybody use Elasticsearch recently can update this process.
What I did with older version of Elasticsearch is depicted in the diagram below.
I created a 'Pipeline Configuration File' (please see the attached sample) in Logstash to extract required information from a CSV file. Then Elasticsearch to create indices which can be utilized by Kibana for data discovering, Visualization and Dashboard.
I followed the Elasticsearch documentation at https://www.elastic.co/guide/index.html
for building the process.
Hope this helps you.
+10- Contributor
pallegama wrote:
Hi @bo,
I have done some testing year ago using Elasticsearch 2.2.0, Logstach 2.2.0 and Kibana 4.4.0.
The process may be changed slightly with new version of Elasticsearch. Anybody use Elasticsearch recently can update this process.
What I did with older version of Elasticsearch is depicted in the diagram below.
I created a 'Pipeline Configuration File' (please see the attached sample) in Logstash to extract required information from a CSV file. Then Elasticsearch to create indices which can be utilized by Kibana for data discovering, Visualization and Dashboard.
I followed the Elasticsearch documentation at https://www.elastic.co/guide/index.html
for building the process.
Hope this helps you.
- If we are only interested in FME server logs, is it possible to use FME server to ship the logs to Elasticsearch in lieu of Logstash?
- How do your send alert emails / text msgs to administrator when certain conditions are met?
Reply
Helpful Members This Week
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.