A new book designed for SysAdmins, Operations staff, Developers and DevOps who are interested in deploying a log management solution using the open source tool LogStash.
In this book we will walk you through installing, deploying, managing and extending LogStash. We're going to do that by introducing you to Example.com, where you're going to start a new job as one of its SysAdmins. The first project you'll be in charge of is developing its new log management solution.
We'll teach you how to:
* Install and deploy LogStash. * Ship events from a LogStash Shipper to a central LogStash server. * Filter incoming events using a variety of techniques. * Output those events to a selection of useful destinations. * Use LogStash's Web interface and alternative interfaces like Kibana. * Scale out your LogStash implementation as your environment grows. * Quickly and easily extend LogStash to deliver additional functionality you might need.
By the end of the book you should have a functional and effective log management solution that you can deploy into your own environment.
Very Good Book for "DevOps", "Systems Administrators" & "Operations Staff". Helps with almost hand-holding on how to deploy the complete "Log Management" infrastructure using Logstash, ElasticSearch, Redis.
Very good read for technical and business mindset people. If you have good amount of logs (rather text files) and if you can enrich the logs with meta-data then you can actually build very useful applications on the top of ElasticSearch Search Engine.
Logstash is a great tool. This book really helps to understand it and get real value from Logstash.
Logstash can be used in many ways. I use it as:
1. A webhook that ingests usage data from mobile apps and servers. As destinations I use Redis, JSON files and Elasticsearch server. With Logstash you get queues for free!
2. A command line tool I use it to rebuild an Elasticsearch environment.
Other than some minor hiccups which needed me to take some quick advice on freenode, this was a really nice intro to the logstash framework.
If you are trying out the setup the author mentions in the book, remember you really need either separate instances or separate hosts for each of the logstash components - the shipper and indexer. if you have only a single host to try this on, you can setup redis and elasticsearch on it just the way mentioned. But put only one of the configs - shipper or central in /etc/logstash.d and use the standard logstash startup script. Put the other config elsewhere and run that config directly using the logstash executable.
Putting both shipper and central/indexer in logstash.d and using the standard startup script is nontrivial to setup, and needs tagging and conditional to make it work.
Everything I already did know about logstash was in this book, everything I wanted to know was not. All information I gathered so far could be found anywhere on the internet. Unfortunately more advanced topics are not covered.
Also, the author provides different solutions for a given problem, but does not elaborate on what the pros and cons are of these given solutions. How do they scale, what are the performance characteristics what are potential bottlenecks?
What I to know, for example, was how to manage and organise multiple indexes and how to perform proper housekeeping on them.
A recurring sentence found in the book was "We're not going to show you ... because that's beyond the scope of this book ..."
And I think the `man` page on plugins is more extensive than the chapter in the book.
LogStash is a wonderful open source tool to parse logs. It has lots of features of recognizing various log files available out of the the box. One can define one's own structure too. One can add on additional information to he information available in the files.
It provides agents to bring the logs generated in multiple servers to a central location and parse it in this central location. This is a very useful feature especially for data centers where a large number of servers need to be monitored and maintained.
It uses Elastic Search for the storage and Kibana for creating graphs and tabular data. The ELK stack has become very popular in the technical world.
Purely awesome LogStash starter - it will help you to understand the tool and it's capabilities without falling into too-narrow details. Covers all typical scenarios (at least the ones I was thinking about), including day-to-day integration patterns.
The content itself is concise, well-formatted and neatly detailed with proper (and readable) examples.
This is exactly what I've expected for the money I've paid - very good book about a very interesting tool.
This book provides really good introduction to very wide and complicated subject of logs management and metrics monitoring. There's not a lot of books around dedicated to this topic, so it makes this one even more valuable. It doesn't include advanced material, unfortunately. I would be happy to have some systematic reading about logs reliability and resilience, best integration practices and so on. Hopefully next edition will cover it in more details.
Not really happy with the book. It does not really differentiate that much with what is available online, and one would expect the book at least to provide for a solution on how to load old log files in batch. It does not.
The good thing: I've purchased the PDF version of the book directly from the author. This means that it gets updated with every major version
A good introduction to the ELK stack (particularly Logstash and Elasticsearch). It has decent coverage of Logstash configuration and some scaling considerations for Logstash and Elasticsearch, but didn't go too far in depth into any topics. It made a light read for me; finished in two sittings.
If you're new to the topic this is worth a read, otherwise it would be too basic.
Very good basis for introducing logstash, elasticsearch, grok filters and scaling. Recommended for anyone starting their first setup or looking to scale/extend an existing installation.
Well worth a read. I definitely have a better handle on LogStash now. I would have liked to have seen just a little more depth in the scaling section but am otherwise quite satisfied.