Data Engineering with Databricks Cookbook : Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake
Language: English
Published by Packt Publishing, 2024
- Softcover
- New

Seller: AHA-BUCH GmbH, Einbeck, GermanyAHA-BUCH GmbH
AbeBooks seller since August 14, 2006
Condition: New
£ 65.59
Quantity: 2 available
Add to basketItem description from seller
nach der Bestellung gedruckt Neuware - Printed after ordering - Work through 70 recipes for implementing reliable data pipelines with Apache Spark, optimally store and process structured and unstructured data in Delta Lake, and use Databricks to orchestrate and govern your dataKey FeaturesLearn data ingestion, data transformation, and data management techniques using Apache Spark and Delta LakeGain practical guidance on using Delta Lake tables and orchestrating data pipelinesImplement reliable DataOps and DevOps practices, and enforce data governance policies on DatabricksPurchase of the print or Kindle book includes a free PDF Elektronisches BuchBook DescriptionData Engineering with Databricks Cookbook will guide you through recipes to effectively use Apache Spark, Delta Lake, and Databricks for data engineering, beginning with an introduction to data ingestion and loading with Apache Spark.As you progress, you'll be introduced to various data manipulation and data transformation solutions that can be applied to data. You'll find out how to manage and optimize Delta tables, as well as how to ingest and process streaming data. The book will also show you how to improve the performance problems of Apache Spark apps and Delta Lake. Later chapters will show you how to use Databricks to implement DataOps and DevOps practices and teach you how to orchestrate and schedule data pipelines using Databricks Workflows. Finally, you'll understand how to set up and configure Unity Catalog for data governance.By the end of this book, you'll be well-versed in building reliable and scalable data pipelines using modern data engineering technologies.What you will learnPerform data loading, ingestion, and processing with Apache SparkDiscover data transformation techniques and custom user-defined functions (UDFs) in Apache SparkManage and optimize Delta tables with Apache Spark and Delta Lake APIsUse Spark Structured Streaming for real-time data processingOptimize Apache Spark application and Delta table query performanceImplement DataOps and DevOps practices on DatabricksOrchestrate data pipelines with Delta Live Tables and Databricks WorkflowsImplement data governance policies with Unity CatalogWho this book is forThis book is for data engineers, data scientists, and data practitioners who want to learn how to build efficient and scalable data pipelines using Apache Spark, Delta Lake, and Databricks. To get the most out of this book, you should have basic knowledge of data architecture, SQL, and Python programming.…
Seller Inventory # 9781837633357
- Title
- Data Engineering with Databricks Cookbook : Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake
- Author
- Pulkit Chadha
- Publisher
- Packt Publishing
- Publication year
- 2024
- Condition
- Neu
- Binding
- Taschenbuch
- Language
- English
- ISBN 10
- 1837633355
- ISBN 13
- 9781837633357
- Item weight
- 813 grams
- Dimensions
- 235x191x24 mm
Work through 70 recipes for implementing reliable data pipelines with Apache Spark, optimally store and process structured and unstructured data in Delta Lake, and use Databricks to orchestrate and govern your data
Key Features
- Learn data ingestion, data transformation, and data management techniques using Apache Spark and Delta Lake
- Gain practical guidance on using Delta Lake tables and orchestrating data pipelines
- Implement reliable DataOps and DevOps practices, and enforce data governance policies on Databricks
- Purchase of the print or Kindle book includes a free PDF eBook
Book Description
Written by a Senior Solutions Architect at Databricks, Data Engineering with Databricks Cookbook will show you how to effectively use Apache Spark, Delta Lake, and Databricks for data engineering, starting with comprehensive introduction to data ingestion and loading with Apache Spark.
What makes this book unique is its recipe-based approach, which will help you put your knowledge to use straight away and tackle common problems. You’ll be introduced to various data manipulation and data transformation solutions that can be applied to data, find out how to manage and optimize Delta tables, and get to grips with ingesting and processing streaming data. The book will also show you how to improve the performance problems of Apache Spark apps and Delta Lake. Advanced recipes later in the book will teach you how to use Databricks to implement DataOps and DevOps practices, as well as how to orchestrate and schedule data pipelines using Databricks Workflows. You’ll also go through the full process of setup and configuration of the Unity Catalog for data governance.
By the end of this book, you’ll be well-versed in building reliable and scalable data pipelines using modern data engineering technologies.
What you will learn
- Perform data loading, ingestion, and processing with Apache Spark
- Discover data transformation techniques and custom user-defined functions (UDFs) in Apache Spark
- Manage and optimize Delta tables with Apache Spark and Delta Lake APIs
- Use Spark Structured Streaming for real-time data processing
- Optimize Apache Spark application and Delta table query performance
- Implement DataOps and DevOps practices on Databricks
- Orchestrate data pipelines with Delta Live Tables and Databricks Workflows
- Implement data governance policies with Unity Catalog
Who this book is for
This book is for data engineers, data scientists, and data practitioners who want to learn how to build efficient and scalable data pipelines using Apache Spark, Delta Lake, and Databricks. To get the most out of this book, you should have basic knowledge of data architecture, SQL, and Python programming.
Table of Contents
- Data Ingestion and Data Extraction with Apache Spark
- Data Transformation and Data Manipulation with Apache Spark
- Data Management with Delta Lake
- Ingesting Streaming Data
- Processing Streaming Data
- Performance Tuning with Apache Spark
- Performance Tuning in Delta Lake
- Orchestration and Scheduling Data Pipeline with Databricks Workflows
- Building Data Pipelines with Delta Live Tables
- Data Governance with Unity Catalog
- Implementing DataOps and DevOps on Databricks
"Synopsis" may belong to another edition of this title.
About the Author
Pulkit Chadha is a Sr. Solutions Architect at Databricks. He has over 12 years of experience working in Data Engineering. With his expertise in building and optimizing data pipelines using various tools and technologies Pulkit has worked with enterprises in various industries, including healthcare, Media and Entertainment, Hi-Tech, and Manufacturing providing data engineering solutions to meet enterprises' unique business needs. His work history includes the likes of Dell Services, Adobe, and Databricks. Pulkit holds a Masters's Degree in Management Information Systems from Eller College of Management at the University Of Arizona and has several cloud certifications in data analytics.
"About the title" may belong to another edition of this title.
Shipping rates from Germany to U.S.A.
| Item | 7 to 10 business days | 5 to 7 business days |
|---|---|---|
| First item | £ 29.20 | £ 37.54 |
Payment methods
- Bank Wire Transfer
- Check
- Paypal
Store description
Das Unternehmen AHA-BUCH GmbH: Seit der Gründung von AHA-BUCH im Juli 2005 ist unser Hauptziel, zufriedenen Kunden so schnell und so preisgünstig wie möglich ihren Bücherwunsch zu erfüllen. Unsere Firma beschäftigt 16 Mitarbeiter, die nur ein Ziel kennen: den Kunden und seine Wünsche! Auf über 3700 m2 Fläche haben wir über 100.000 Bücher, Modernes Antiquariat und Spiele auf Lager.
Specialty
Kinderbücher & Kinderhör Casetten, German Books, Software, Natur & Tiere, Ratgeber, Sachbücher, Englische Bücher, Medizin & Gesundheit, Universität & StudiumSeller's business information
AHA-BUCH GmbH
Garlebsen 48
Einbeck, Germany 37574
Imprint
Seller Info:
AHA-BUCH GmbH
represented by the managing director Christel Glass
Garlebsen 48
37574 Einbeck
Deutschland
Telefon: 055639996039
Telefax: 055639995974
E-Mail: abebooks@aha-buch.de
USt-IdNr.: DE261904229
registered at Commercial register Amtsgerichtes Göttingen
Handelsregisternummer HRB 200691
Alternative dispute resolution:
The European Commission provides a platform for out-of-court online dispute resolution (ODR platform), which can be accessed under https://ec.europa.eu/odr.
We have been a member of the "FairCommerce" initiative since 25.05.2018.
For more information, see www.fair-commerce.de.
Terms of sale
General Terms and Conditions and Customer Information / Privacy Policy
I. General Terms and Conditions
§ 1 Basic provisions
(1) The following terms and conditions apply to all contracts that you conclude with us as a provider (AHA-BUCH GmbH) via the Internet platforms AbeBooks and/or ZVAB. Unless otherwise agreed, the inclusion of any of your own terms and conditions used by you will be objected to
(2) A consumer within the meaning of the following regulations is any natural person who concludes a legal transaction for purposes that can predominantly be attributed neither to their commercial nor their independent professional activity. An entrepreneur is any natural or legal person or a partnership with legal capacity who, when concluding a legal transaction, acts in the exercise of his independent professional or commercial activity.
§ 2 Conclusion of the contract
(1) The object of the contract is the sale of goods.
(2) If an article is listed by us at AbeBooks or ZVAB, the activation of the offer page at AbeBooks or ZVAB constitutes the binding offer to conclude a contract under the conditions contained in the article page.
(3) The contract is concluded via the online shopping cart system as follows:
The goods intended for purchase are stored in the "shopping cart". Via the corresponding button in the navigation bar you can call up the "shopping cart" and make changes there at any time.
After calling up the "Checkout" page and entering the personal data as well as the payment and shipping conditions, all order data will be displayed again on the order overview page.
Before sending the order, you have the option of checking all information again, changing it (also via the "back" function of the Internet browser) or cancelling the purchase.
By submitting the order via the "Buy now" button, you declare the acceptance of the offer in a legally binding manner, whereby the contract is concluded.
(4) The processing of the order and transmission of all information required in connection with the conclusion of the contract is partly automated by e-mail. You must therefore ensure that the e-mail address you have stored with us is correct, that the receipt of the e-mails is technically ensured and, in particular, that spam filters do not prevent it.
§ 3 Right of retention, retention of title
(1) You can only exercise a right of retention if it concerns claims from the same contractual relationship.
(2) The goods remain our property until full payment of the purchase price.
§ 4 Warranty
(1) The statutory warranty rights exist.
(2) In the case of used goods, the warranty period is one year from delivery of the item, deviating from the statutory regulation. The shortening of the deadline does not apply:
- culpably caused damages attributable to us from injury to life, limb or health and in the case of other damages caused intentionally or through gross negligence;
- insofar as we have fraudulently concealed the defect or have assumed a guarantee for the quality of the item.
(3) As a consumer, you are requested to check the item immediately upon delivery for completeness, obvious defects and transport damage and to inform us and the freight forwarder of any complaints as soon as possible. If you do not comply with this, this will have no effect on your statutory warranty claims.
§ 5 Choice of law, place of performance, place of jurisdiction
(1) German law shall apply. In the case of consumers, this choice of law shall only apply insofar as this does not withdraw the protection afforded by mandatory provisions of the law of the state of the consumer's habitual residence (principle of favourability).
(2) The place of performance for all services arising from the existing business relationships with us as well as the place of jurisdiction is our registered office, insofar as you are not a consumer, but a merchant, a legal entity under public law or a special fund under public law. The same applies if you do not have a general place of jurisdiction in Germany or the EU or if the domicile or habitual residence is not known at the time the action is brought. The right to appeal to the court at another statutory place of jurisdiction remains unaffected by this.
(3) The provisions of the UN Convention on Contracts for the International Sale of Goods shall expressly not apply.
II. Customer Information
- Identity of the Seller
AHA-BUCH GmbH
Garlebsen 48
D-37574 Einbeck
Germany
Telephone: 055639996039
E-mail: abebooks@aha-buch.de.
Alternative dispute resolution:
The European Commission provides a platform for out-of-court online dispute resolution (ODR platform), which can be accessed under https://ec.europa.eu/odr.
- Information on the conclusion of the contract
The technical steps for the conclusion of the contract, the conclusion of the contract itself and the correction options are carried out in accordance with the provisions "Conclusion of the contract" of our General Terms and Conditions (Part I.).
- Contract language, contract text storage
3.1. The contract language is german.
3.2. The complete text of the contract will not be stored by us. Before sending the order, the contract data can be printed out or electronically saved via the print function of the browser. After receipt of the order by us, the order data, the legally prescribed information for distance contracts and the General Terms and Conditions will be sent to you again by e-mail.
- Essential characteristics of the goods or services
The essential characteristics of the goods and/or services can be found in the respective offer.
- Prices and terms of payment
5.1. The prices stated in the respective offers as well as the shipping costs represent total prices. They include all price components including all applicable taxes.
5.2. The shipping costs incurred are not included in the purchase price. They can be called up via a correspondingly designated button on our website or in the respective offer, are shown separately in the course of the ordering process and are to be borne by you in addition, unless free shipping has been promised.
5.3. If the delivery is made to countries outside the European Union, we may incur additional costs for which we are not responsible, such as.B customs duties, taxes or money transfer fees (transfer or exchange rate fees of the credit institutions), which are to be borne by you. Any costs incurred for the transfer of money shall also be borne by you in cases where the delivery is made to an EU member state, but the payment was initiated outside the European Union.
5.4. The payment methods available to you are indicated under a corresponding button on our website or in the respective offer.
5.5. Unless otherwise stated for the individual payment methods, the payment claims from the concluded contract are due for payment immediately.
- Terms of delivery
6.1. The terms of delivery, the delivery date and, if applicable, existing delivery restrictions can be found under a correspondingly designated button on our website or in the respective offer.
Insofar as no other deadline is specified in the respective offer or under the correspondingly designated button, the delivery of the goods will take place within 3-5 days after conclusion of the contract (in the case of agreed advance payment, however, only after the time of your payment instruction).
6.2. Insofar as you are a consumer, it is regulated by law that the risk of accidental loss and accidental deterioration of the sold item during dispatch shall only pass to you upon handover of the goods, regardless of whether the shipment is insured or uninsured. This does not apply if you have independently commissioned a transport company not named by the entrepreneur or a person otherwise designated to carry out the shipment.
- Statutory liability for defects
Liability for defects is governed by the "Warranty" provision in our General Terms and Conditions (Part I).
last update: 01/06/2022
Privacy policy
Unless otherwise stated below, the provision of your personal data is neither required by law or contract, nor is it necessary for the conclusion of a contract. You are not obliged to provide the data. Failure to provide this will have no consequences. This only applies if no other information is provided in the subsequent processing operations.
Collection, processing and disclosure of personal data when placing orders
When ordering, we collect and process your personal data only to the extent necessary to fulfil and process your order and to process your enquiries. The provision of the data is necessary for the conclusion of the contract. Failure to provide this provision means that no contract can be concluded. The processing takes place on the basis of Art. 6 para. 1 lit.b GDPR and is necessary for the performance of a contract with you.
Your data will be passed on, for example, to the shipping companies and dropshipping providers selected by you, payment service providers, service providers for order processing and IT service providers.
In all cases, we strictly observe the legal requirements. The scope of data transmission is limited to a minimum.
Duration of storage
After completion of the contract, the data will first be stored for the duration of the warranty period, then taking into account legal, in particular tax and commercial retention periods and then deleted after expiry of the period, unless you have consented to further processing and use.
Rights of the data subject
If the legal requirements are met, you have the following rights under Articles 15 to 20 GDPR: Right to information, to correction, to erasure, to restriction of processing, to data portability.
In addition, pursuant to Article 21 (1) GDPR, you have the right to object to processing based on Article 6 (1) f GDPR and to processing for direct marketing purposes.
Contact us on request. The contact details can be found in our imprint.
Right to lodge a complaint with the supervisory authority
In accordance with Article 77 GDPR, you have the right to complain to the supervisory authority if you believe that the processing of your personal data is not lawful.
Right to object
If the personal data processing listed here is based on our legitimate interest pursuant to Art. 6 para. 1 lit. f GDPR, you have the right to object to this processing at any time with effect for the future for reasons arising from your particular situation.
Right of withdrawal
If you are a consumer you can withdraw from the contract in accordance with the following. Consumer means any natural person who is acting for purposes which are outside his trade, business, craft or profession.
Information regarding the right of withdrawal
Statutory right to withdraw
You have the right to withdraw from this contract within 14 days without giving any reason.
The withdrawal period will expire after 14 days from the day on which you acquire, or a third party other than the carrier and indicated by you acquires, physical possession of the last good or the last lot or piece.
To exercise the right of withdrawal, electronically fill in and submit a clear statement on our website, under "My Purchases" in "My Account". We will communicate to you an acknowledgement of receipt of such a withdrawal on a durable medium (e.g. by e-mail) without delay.
To meet the withdrawal deadline, it is sufficient for you to send your communication concerning your exercise of the right of withdrawal before the withdrawal period has expired.
Effects of withdrawal
If you withdraw from this contract, we will reimburse to you all payments received from you, including the costs of delivery (except for the supplementary costs arising if you chose a type of delivery other than the least expensive type of standard delivery offered by us).
We may make a deduction from the reimbursement for loss in value of any goods supplied, if the loss is the result of unnecessary handling by you.
We will make the reimbursement without undue delay, and not later than 14 days after the day on which we are informed about your decision to withdraw from this contract.
We will make the reimbursement using the same means of payment as you used for the initial transaction, unless you have expressly agreed otherwise; in any event, you will not incur any fees as a result of such reimbursement.
We may withhold reimbursement until we have received the goods back, or you have supplied evidence of having sent back the goods, whichever is the earliest.
You shall send back the goods or hand them over to AHA-BUCH GmbH, Einbeck, Germany, without undue delay and in any event not later than 14 days from the day on which you communicate your withdrawal from this contract to us. The deadline is met if you send back the goods before the period of 14 days has expired. You will have to bear the direct cost of returning the goods. You are only liable for any diminished value of the goods resulting from the handling other than what is necessary to establish the nature, characteristics and functioning of the goods.
Exceptions to the right of withdrawal
The right of withdrawal does not apply to:
- The delivery of newspapers, journals or magazines with the exception of subscription contracts; and
- The supply of digital content which is not supplied on a tangible medium (e.g. on a CD or DVD) if you accepted when you placed your order that we could start to deliver it, and that you could not withdraw once delivery had started.
Shipping terms
We ship your order after we received them
for articles on hand latest 24 hours,
for articles with overnight supply latest 48 hours.
In case we need to order an article from our supplier our dispatch time depends on the reception date of the articles, but the articles will be shipped on the same day.
Our goal is to send the ordered articles in the fastest, but also most efficient and secure way to our customers.
Privacy and security
Privacy policy
Unless otherwise stated below, the provision of your personal data is neither required by law or contract, nor is it necessary for the conclusion of a contract. You are not obliged to provide the data. Failure to provide this will have no consequences. This only applies if no other information is provided in the subsequent processing operations.
Collection, processing and use of personal data for orders
When ordering, we collect and use your personal data only to the extent necessary to fulfill and process your order and to process your inquiries. The provision of the data is necessary for the conclusion of the contract. Failure to provide this provision means that no contract can be concluded. The processing takes place on the basis of Art. 6 (1) lit.b GDPR and is necessary for the performance of a contract with you. Your data will not be passed on to third parties without your express consent. Excluded from this are only our service partners, which we need to process the contractual relationship or service providers whom we use in the context of order processing. In addition to the recipients named in the respective clauses of this data protection declaration, these are, for example, recipients of the following categories: shipping service providers, payment service providers, merchandise management service providers, service providers for order processing, web hosts, IT service providers and dropshipping merchants. In all cases, we strictly observe the legal requirements. The scope of data transmission is limited to a minimum.
Duration of storage
After completion of the contract, the data will first be stored for the duration of the warranty period, then taking into account legal, in particular tax and commercial retention periods and then deleted after expiry of the period, unless you have consented to further processing and use.
Rights of the data subject
If the legal requirements are met, you have the following rights under Articles 15 to 20 GDPR: Right to information, to correction, to erasure, to restriction of processing, to data portability. In addition, pursuant to Article 21 (1) GDPR, you have the right to object to processing based on Article 6 (1) f GDPR and to processing for direct marketing purposes.
Contact us on request. The contact details can be found in our imprint.
Right to lodge a complaint with the supervisory authority
In accordance with Article 77 GDPR, you have the right to complain to the supervisory authority if you believe that the processing of your personal data is not lawful.
last updated: 01/06/2022