Working with big data can be complex and challenging, in part because of the multiple analysis frameworks and tools required. Apache Spark is a big data processing framework perfect for analyzing near-real-time streams and discovering historical patterns in batched data sets. But Spark goes much further than other frameworks. By including machine learning and graph processing capabilities, it makes many specialized data processing platforms obsolete. Spark's unified framework and programming model significantly lowers the initial infrastructure investment, and Spark's core abstractions are intuitive for most Scala, Java, and Python developers.
Spark in Action teaches you to use Spark for stream and batch data processing. It starts with an introduction to the Spark architecture and ecosystem followed by a taste of Spark's command line interface. You then discover the most fundamental concepts and abstractions of Spark, particularly Resilient Distributed Datasets (RDDs) and the basic data transformations that RDDs provide. The first part of the book also introduces you to writing Spark applications using the the core APIs. Next, you learn about different Spark components: how to work with structured data using Spark SQL, how to process near-real time data with Spark Streaming, how to apply machine learning algorithms with Spark MLlib, how to apply graph algorithms on graph-shaped data using Spark GraphX, and a clear introduction to Spark clustering.
The author’s sense of humor and weird analogues makes this a bit of a burden to read. Real life datasets and examples are nice though. Probably worth looking into if you are fetting started with spark with a regular developer background.
The book is pretty well written, with even a drop of (unexpected) humor. This, with the good addition of well done illustrations makes this book an honorable "in action" series member. However, I quit with a feeling of frustration, because examples are rather fragments, written trhough the CLI. I have no idea what a full fledged "hello world" would looks like ! And this is only fragments because the subject was indeed very large. I think the authoe would have better leave the advanced subjects for another book. Because this one is really compact ! Ma note de lecture en Français ici