Engineering Big Data Pipelines with Hadoop and Spark (Paperback)
Language: English
Published by Independently Published, 2026
- Softcover
- New
Seller: Grand Eagle Retail, Bensenville, IL, U.S.A.Grand Eagle Retail
AbeBooks seller since October 12, 2005
Condition: New
£ 18.80
Quantity: 1 available
Add to basketItem description from seller
Paperback. Learn how to build practical big data pipelines with Hadoop, Apache Spark, and PySpark.As datasets grow beyond the practical limits of a single computer, organizations need reliable ways to store, process, clean, transform, and analyze information at scale. Engineering Big Data Pipelines with Hadoop and Spark provides a practical introduction to the tools and workflows used to solve these problems.This beginner friendly guide takes you from the foundations of big data and distributed computing to complete processing pipelines using Hadoop, Spark, and Python. You will learn not only what the technologies do, but how their individual components fit together in a repeatable data engineering workflow.Inside this book, you will learn how to: Understand big data, distributed computing, batch processing, and streamingUnderstand the Hadoop ecosystem and how its major components work togetherWork with HDFS for distributed storageUnderstand MapReduce and parallel batch processingUse YARN for cluster resource managementSet up Hadoop, Spark, and PySpark on a practical local environmentCreate and work with PySpark applicationsUnderstand RDDs, transformations, actions, and Spark executionWork with Spark DataFrames for large scale data processingQuery large datasets using Spark SQLRead and clean CSV, JSON, and Parquet datasetsTransform large datasets using PySparkUnderstand partitions, shuffling, caching, persistence, and broadcast joinsRead Spark execution plans and use the Spark Web UI for performance analysisProcess continuously arriving data with Structured StreamingBuild introductory machine learning workflows using Spark MLlibDevelop classification and regression models with SparkSave and reload machine learning pipelinesBuild and monitor a complete end to end big data processing projectThe book emphasizes a practical workflow rather than memorizing commands. You will learn to move data through a complete pipeline: store it, inspect it, clean it, transform it, analyze it, optimize the processing job, and save the results.Practical examples use familiar business data including sales transactions, customer orders, product records, website logs, incoming events, and customer behavior data. The final project combines the major skills developed throughout the book by moving raw transaction data into HDFS, processing it with PySpark, analyzing it with Spark SQL, optimizing the job, and saving the results as Parquet.You do not need previous experience with Hadoop, Spark, distributed systems, or data engineering. Basic computer skills are enough to begin, while some familiarity with Python and SQL can be helpful as you progress into PySpark and Spark SQL.Whether you are a student learning data processing, a Python user working with larger datasets, an analyst exploring distributed computing, a software developer moving into data engineering, or a technical professional preparing to work with Hadoop and Spark, this book provides a structured path from fundamentals to practical implementation.Build the skills to design, process, optimize, and understand large scale data pipelines with Hadoop, Spark, and PySpark. This item is printed on demand. Shipping may be from multiple locations in the US or from the UK, depending on stock availability.…
Seller Inventory # 9798192589724
- Title
- Engineering Big Data Pipelines with Hadoop and Spark (Paperback)
- Author
- Nathan Westwood
- Publisher
- Independently Published
- Publication year
- 2026
- Condition
- new
- Binding
- Paperback
- Language
- English
- ISBN 13
- 9798192589724
Learn how to build practical big data pipelines with Hadoop, Apache Spark, and PySpark.
As datasets grow beyond the practical limits of a single computer, organizations need reliable ways to store, process, clean, transform, and analyze information at scale. Engineering Big Data Pipelines with Hadoop and Spark provides a practical introduction to the tools and workflows used to solve these problems.
This beginner friendly guide takes you from the foundations of big data and distributed computing to complete processing pipelines using Hadoop, Spark, and Python. You will learn not only what the technologies do, but how their individual components fit together in a repeatable data engineering workflow.
Inside this book, you will learn how to:
- Understand big data, distributed computing, batch processing, and streaming
- Understand the Hadoop ecosystem and how its major components work together
- Work with HDFS for distributed storage
- Understand MapReduce and parallel batch processing
- Use YARN for cluster resource management
- Set up Hadoop, Spark, and PySpark on a practical local environment
- Create and work with PySpark applications
- Understand RDDs, transformations, actions, and Spark execution
- Work with Spark DataFrames for large scale data processing
- Query large datasets using Spark SQL
- Read and clean CSV, JSON, and Parquet datasets
- Transform large datasets using PySpark
- Understand partitions, shuffling, caching, persistence, and broadcast joins
- Read Spark execution plans and use the Spark Web UI for performance analysis
- Process continuously arriving data with Structured Streaming
- Build introductory machine learning workflows using Spark MLlib
- Develop classification and regression models with Spark
- Save and reload machine learning pipelines
- Build and monitor a complete end to end big data processing project
The book emphasizes a practical workflow rather than memorizing commands. You will learn to move data through a complete pipeline: store it, inspect it, clean it, transform it, analyze it, optimize the processing job, and save the results.
Practical examples use familiar business data including sales transactions, customer orders, product records, website logs, incoming events, and customer behavior data. The final project combines the major skills developed throughout the book by moving raw transaction data into HDFS, processing it with PySpark, analyzing it with Spark SQL, optimizing the job, and saving the results as Parquet.
You do not need previous experience with Hadoop, Spark, distributed systems, or data engineering. Basic computer skills are enough to begin, while some familiarity with Python and SQL can be helpful as you progress into PySpark and Spark SQL.
Whether you are a student learning data processing, a Python user working with larger datasets, an analyst exploring distributed computing, a software developer moving into data engineering, or a technical professional preparing to work with Hadoop and Spark, this book provides a structured path from fundamentals to practical implementation.
Build the skills to design, process, optimize, and understand large scale data pipelines with Hadoop, Spark, and PySpark.
"Synopsis" may belong to another edition of this title.
Grand Eagle Retail
Bensenville, IL, U.S.A.
AbeBooks seller since October 12, 2005
Shipping rates within U.S.A.
| Item | 6 to 14 business days | 6 to 16 business days |
|---|---|---|
| First item | £ 0.00 | £ 0.00 |
Payment methods
Seller's business information
APOLLO ONLINE CORP.
605 Geddes Street
Wilmington, DE U.S.A. 19805
Terms of sale
We guarantee the condition of every book as it¿s described on the Abebooks web sites. If you¿ve changed
your mind about a book that you¿ve ordered, please use the Ask bookseller a question link to contact us
and we¿ll respond within 2 business days.
Books ship from California and Michigan.
Right of withdrawal
If you are a consumer you can withdraw from the contract in accordance with the following. Consumer means any natural person who is acting for purposes which are outside his trade, business, craft or profession.
Information regarding the right of withdrawal
Statutory right to withdraw
You have the right to withdraw from this contract within 14 days without giving any reason.
The withdrawal period will expire after 14 days from the day on which you acquire, or a third party other than the carrier and indicated by you acquires, physical possession of the last good or the last lot or piece.
To exercise the right of withdrawal, electronically fill in and submit a clear statement on our website, under "My Purchases" in "My Account". We will communicate to you an acknowledgement of receipt of such a withdrawal on a durable medium (e.g. by e-mail) without delay.
To meet the withdrawal deadline, it is sufficient for you to send your communication concerning your exercise of the right of withdrawal before the withdrawal period has expired.
Effects of withdrawal
If you withdraw from this contract, we will reimburse to you all payments received from you, including the costs of delivery (except for the supplementary costs arising if you chose a type of delivery other than the least expensive type of standard delivery offered by us).
We may make a deduction from the reimbursement for loss in value of any goods supplied, if the loss is the result of unnecessary handling by you.
We will make the reimbursement without undue delay, and not later than 14 days after the day on which we are informed about your decision to withdraw from this contract.
We will make the reimbursement using the same means of payment as you used for the initial transaction, unless you have expressly agreed otherwise; in any event, you will not incur any fees as a result of such reimbursement.
We may withhold reimbursement until we have received the goods back, or you have supplied evidence of having sent back the goods, whichever is the earliest.
You shall send back the goods or hand them over to Grand Eagle Retail, Bensenville, Illinois, U.S.A., without undue delay and in any event not later than 14 days from the day on which you communicate your withdrawal from this contract to us. The deadline is met if you send back the goods before the period of 14 days has expired. You will have to bear the direct cost of returning the goods. You are only liable for any diminished value of the goods resulting from the handling other than what is necessary to establish the nature, characteristics and functioning of the goods.
Exceptions to the right of withdrawal
The right of withdrawal does not apply to:
- The delivery of newspapers, journals or magazines with the exception of subscription contracts; and
- The supply of digital content which is not supplied on a tangible medium (e.g. on a CD or DVD) if you accepted when you placed your order that we could start to deliver it, and that you could not withdraw once delivery had started.
Shipping terms
Orders usually ship within 2 business days. All books within the US ship free of charge. Delivery is 4-14 business days anywhere in the United States.
Books ship from California and Michigan.
If your book order is heavy or oversized, we may contact you to let you know extra shipping is required.