A book about running Elasticsearch
WIP, COVERS ELASTICSEARCH 5.5.x, UPDATING TO ES 6.5.x
Is your cluster healthy for real?
Monitoring Elasticsearch is the most important and most difficult part of deploying a cluster. The elements to monitor are countless, and not all of them are worth raising an alert. There are some common points though, but the fine monitoring really depends on the workload and use you need.
This chapter is divided into 3 different parts, covering the 3 most important environments to monitor:
Each parts extensively covers the critical things to have a look at, and gives you an overview to the little thing that might be worse checking when troubleshooting.
Elastic provides an extensive monitoring system through the X-Pack plugin. X-Pack has a free license with some functional limitations. The free license only lets you manage a single cluster, a limited amount of nodes, and has a limited data retention. X-Pack documentation is available at https://www.elastic.co/guide/en/x-pack/index.html
I have released 3 Grafana dashboards to monitor Elasticsearch Clusters using the data pushed by the X-Pack monitoring plugin. They provide much more information then the X-Pack monitoring interface, and are meant to be used when you need to gather data from various sources. They are not meant to replace X-Pack since they don’t provide security, alerting or machine learning feature.
Monitoring at the cluster level: https://grafana.com/dashboards/3592
Monitoring at the node level: https://grafana.com/dashboards/3595
Monitoring at the index level: https://grafana.com/dashboards/3598
These dashboards are meant to provide a look at everything Elasticsearch sends to the monitoring node. It doesn’t mean you’ll actually need this data.