Learning Real-time Processing with Spark Streaming - Softcover

Sumit Gupta

9781783987665: Learning Real-time Processing with Spark Streaming

Softcover

ISBN 10: 1783987669 ISBN 13: 9781783987665

Publisher: Packt Publishing - ebooks Account, 2015

View all copies of this ISBN edition

2 Used

From � 65.16

0 New

Building scalable and fault-tolerant streaming applications made easy with Spark streaming

About This Book

Process live data streams more efficiently with better fault recovery using Spark Streaming
Implement and deploy real-time log file analysis
Learn about integration with Advance Spark Libraries - GraphX, Spark SQL, and MLib.

Who This Book Is For

This book is intended for big data developers with basic knowledge of Scala but no knowledge of Spark. It will help you grasp the basics of developing real-time applications with Spark and understand efficient programming of core elements and applications.

What You Will Learn

Install and configure Spark and Spark Streaming to execute applications
Explore the architecture and components of Spark and Spark Streaming to use it as a base for other libraries
Process distributed log files in real-time to load data from distributed sources
Apply transformations on streaming data to use its functions
Integrate Apache Spark with the various advance libraries like MLib and GraphX
Apply production deployment scenarios to deploy your application

In Detail

Using practical examples with easy-to-follow steps, this book will teach you how to build real-time applications with Spark Streaming.

Starting with installing and setting the required environment, you will write and execute your first program for Spark Streaming. This will be followed by exploring the architecture and components of Spark Streaming along with an overview of libraries/functions exposed by Spark. Next you will be taught about various client APIs for coding in Spark by using the use-case of distributed log file processing. You will then apply various functions to transform and enrich streaming data. Next you will learn how to cache and persist datasets. Moving on you will integrate Apache Spark with various other libraries/components of Spark like Mlib, GraphX, and Spark SQL. Finally, you will learn about deploying your application and cover the different scenarios ranging from standalone mode to distributed mode using Mesos, Yarn, and private data centers or on cloud infrastructure.

"synopsis" may belong to another edition of this title.

About the Author

Sumit Gupta is a seasoned professional, innovator, and technology evangelist with over 100 months of experience in architecting, managing, and delivering enterprise solutions revolving around a variety of business domains such as hospitality, healthcare, risk management, insurance, and so on. He is passionate about technology with an overall 14 years of hands-on experience in the software industry and has been using big data and cloud technologies over the past 4 to 5 years to solve complex business problems. He is also the author of Neo4j Essentials and Building Web Applications with Python and Neo4j both by Packt Publishing.

"About this title" may belong to another edition of this title.