The Azure Data Lakehouse Toolkit
Building and Scaling Data Lakehouses on Azure with Delta Lake, Apache Spark, Databricks, Synapse Analytics, and Snowflake
Buch in deiner Nähe kaufen
Beschreibung
Design and implement a modern data lakehouse on the Azure Data Platform using Delta Lake, Apache Spark, Azure Databricks, Azure Synapse Analytics, and Snowflake. This book teaches you the intricate details of the Data Lakehouse Paradigm and how to efficiently design a cloud-based data lakehouse using highly performant and cutting-edge Apache Spark capabilities using Azure Databricks, Azure Synapse Analytics, and Snowflake. You will learn to write efficient PySpark code for batch and streaming ELT jobs on Azure. And you will follow along with practical, scenario-based examples showing how to apply the capabilities of Delta Lake and Apache Spark to optimize performance, and secure, share, and manage a high volume, high velocity, and high variety of data in your lakehouse with ease.
The patterns of success that you acquire from reading this book will help you hone your skills to build high-performing and scalable ACID-compliant lakehouses using flexible and cost-efficient decoupledstorage and compute capabilities. Extensive coverage of Delta Lake ensures that you are aware of and can benefit from all that this new, open source storage layer can offer. In addition to the deep examples on Databricks in the book, there is coverage of alternative platforms such as Synapse Analytics and Snowflake so that you can make the right platform choice for your needs.
What You Will Learn
- Implement the Data Lakehouse Paradigm on Microsoft’s Azure cloud platform
- Benefit from the new Delta Lake open-source storage layer for data lakehouses
- Take advantage of schema evolution, change feeds, live tables, and more
- Write functional PySparkcode for data lakehouse ELT jobs
- Optimize Apache Spark performance through partitioning, indexing, and other tuning options
- Choose between alternatives such as Databricks, Synapse Analytics, and Snowflake
Design and implement a modern data lakehouse on the Azure Data Platform using Delta Lake, Apache Spark, Azure Databricks, Azure Synapse Analytics, and Snowflake. This book teaches you the intricate details of the Data Lakehouse Paradigm and how to efficiently design a cloud-based data lakehouse using highly performant and cutting-edge Apache Spark capabilities using Azure Databricks, Azure Synapse Analytics, and Snowflake. You will learn to write efficient PySpark code for batch and streaming ELT jobs on Azure. And you will follow along with practical, scenario-based examples showing how to apply the capabilities of Delta Lake and Apache Spark to optimize performance, and secure, share, and manage a high volume, high velocity, and high variety of data in your lakehouse with ease.
The patterns of success that you acquire from reading this book will help you hone your skills to build high-performing and scalable ACID-compliant lakehouses using flexible and cost-efficient decoupled storage and compute capabilities. Extensive coverage of Delta Lake ensures that you are aware of and can benefit from all that this new, open source storage layer can offer. In addition to the deep examples on Databricks in the book, there is coverage of alternative platforms such as Synapse Analytics and Snowflake so that you can make the right platform choice for your needs.
What You Will Learn
- Implement the Data Lakehouse Paradigm on Microsoft’s Azure cloud platform
- Benefit from the new Delta Lake open-source storage layer for data lakehouses
- Take advantage of schema evolution, change feeds, live tables, and more
- Writefunctional PySpark code for data lakehouse ELT jobs
- Optimize Apache Spark performance through partitioning, indexing, and other tuning options
- Choose between alternatives such as Databricks, Synapse Analytics, and Snowflake
Who This Book Is For
Data, analytics, and AI professionals at all levels, including data architect and data engineer practitioners. Also for data professionals seeking patterns of success by which to remain relevant as they learn to build scalable data lakehouses for their organizations and customers who are migrating into the modern Azure Data Platform.
Shows data lakehouse design using Apache Spark on Azure Teaches performance optimization techniques for Spark queries Provides hands-on PySpark and Delta Lake examples for lakehouse ELT jobs
Autor*in
Ron L'Esteve
Themen in »The Azure Data Lakehouse Toolkit«
Azure Data Lakehouse Delta Lake Apache Spark Cloud Data Engineering Azure Data Architecture Azure Data Platform Azure Synapse Analytics PySpark Snowflake Databricks The Enterprise Big Data Lake Big Data Processing SQL Analytics Performance Optimization