Stream Processing with Apache Spark: Best Practices for Scaling and Optimizing Apache Spark

by Gerard Maas, Francois Garillot

Before you can build analytics tools to gain quick insights, you first need to know how to process data in real time. With this practical guide, developers familiar with Apache Spark will learn how to put this in-memory framework to use for streaming data. You'll discover how Spark enables you to write streaming jobs in almost the same way you write batch jobs.

Authors Gerard Maas and Fran�ois Garillot help you explore the theoretical underpinnings of Apache Spark. This comprehensive guide features two sections that compare and contrast the streaming APIs Spark now the original Spark Streaming library and the newer Structured Streaming API.


Learn fundamental stream processing concepts and examine different streaming architectures
Explore Structured Streaming through practical examples; learn different aspects of stream processing in detail
Create and operate streaming jobs and applications with Spark Streaming; integrate Spark Streaming with other Spark APIs
Learn advanced Spark Streaming techniques, including approximation algorithms and machine learning algorithms
Compare Apache Spark to other stream processing projects, including Apache Storm, Apache Flink, and Apache Kafka Streams

Genres: Technology

452 pages, Kindle Edition

Published June 5, 2019

Reviews

[Alex Ott · Rating 4 out of 5]

Very good description of Spark Streaming & Spark Structured Streaming, with many examples, and useful tips. Book is quite new, and covers latest developments (Spark 2.3, and mentions 2.4 in several places) in area of streaming data processing in Spark

I really wish I had this book ~4 years ago when we build our system on the top of the Spark Streaming. One star was taken because of the errors...

[Lorenzo Boccalon · Rating 4 out of 5]

A complete manual on Apache Spark streaming components. It is detailed and contains a few practical examples. I didn't check the online resources but they seem a good supplement. I skipped part 3 as it covers the "legacy" streaming component.

[Michael A. Bodkin]

Very helpful.