We've been using Elasticsearch at prom.ua for more than 4 years now. During this timespan we evolved our cluster from a couple of machines to almost hundred and successfully scaled its traffic from hundreds of queries per second to tens of thousands. In this talk I will try to share the bittersweet lessons learned from this adventure and tell about tools and approaches we use daily to work with this search engine. As a bonus part, I will tell you how we built a logging system which is able to process 700 million records per day for free and what came out of it.
- Developer at prom.ua
- Interested in stable, non-crashing systems
- Watched Grafana until the end once