Tags: Elasticsearch

Writing Your Own Ingest Processor for Elasticsearch

With Elasticsearch 5.0, a new feature called the ingest node was introduced. To quote the official documentation: You can use ingest node to pre-process documents before the actual indexing takes place. This pre-processing happens by an ingest node that intercepts bulk and index requests, applies...
Read 0 Comments

How to Solve 5 Elasticsearch Performance and Scaling Problems

This post is the final part of a 4-part series on monitoring Elasticsearch performance. Part 1 provides an overview of Elasticsearch and its key performance metrics, Part 2 explains how to collect these metrics, and Part 3 describes how to monitor Elasticsearch with Datadog. Like a car,...
Read 0 Comments

Monitoring Docker Containers with Elasticsearch and cAdvisor

If you’re running a Swarm Mode cluster or even a single Docker engine, you’ll end up asking this question: How do I keep track of all that’s happening? The answer is “not easily.” You need a few things to have a complete overview of stuff like: Number and status of containers If, where, and when...
Read 0 Comments

How To Install Elasticsearch, Logstash, and Kibana (ELK Stack) on CentOS/RHEL 7

If you are a person who is, or has been in the past, in charge of inspecting and analyzing system logs in Linux, you know what a nightmare that task can become if multiple services are being monitored simultaneously. In days past, that task had to be done mostly manually, with each log type being...
Read 0 Comments

Field notes - ElasticSearch at Petabyte Scale on AWS

I manage a somewhat sizable fleet of ElasticSearch clusters. How large? Well, "large" is relative these days. Strictly in ElasticSearch data nodes, it's currently operating at the order of: several petabytes of provisioned data-node storage thousands of Xeon E5 v3 cores 10s of terabytes of memory...
Read 0 Comments

Gathering Insights from Data: An Overview of the Elastic Stack

The Elastic stack is a versatile collection of open source software tools that make gathering insights from data easier. Formerly referred to as the ELK stack (in reference to Elasticsearch, Logstash, and Kibana), the growing list of tools that integrate with the platform (such as Beats) have...
Read 0 Comments
Click Here!