Getting Started with the Databricks Lakehouse Platform
This course will teach you how the Data Lakehouse architecture brings you the best of both Data Lakes and Data Warehouses allowing you to meet your data needs for big data processing, SQL analytics, and machine learning in a single platform.
What you'll learn
Organizations have long collected data in a variety of formats, structured, unstructured, and semi-structured data. However, working with data in different formats for different use-cases requires multiple platform data warehouses for structured data needed for business intelligence and data lakes for unstructured data needed for data science and machine learning. The Databricks data lakehouse architecture is an innovative paradigm that combines the flexibility and cost efficiency of a data lake with the reliability and features of a data warehouse.
In this course, Getting Started with the Databricks Lakehouse Platform, you will learn the importance of storing data in a centralized repository and how data lakes and data warehouses serve to solve different data-related problems. First, you’ll explore a variety of technologies in the analytics space and how the lakehouse platform encompasses their strengths while mitigating their limitations.
Next, you will understand the basic components that make up the architecture of a data lakehouse and how the Databricks Lakehouse Platform uses Delta Lakes to enable both SQL analytics and data science and machine learning using the same underlying data lake storage.
Finally, you will explore the Databricks Data Lakehouse on Microsoft Azure. You will build the data lakehouse, store data in Delta Tables, and access the same data using Apache Spark and SQL queries.
When you are finished with this course, you will be able to clearly articulate how the data lakehouse platform helps mitigate challenges with current data architectures and will know hands-on how you can set up and use the lakehouse on Databricks.
Table of contents
- The Databricks Data Platform 3m
- Demo: Setting up and Exploring the Databricks Workspace 5m
- Demo: Creating a Cluster and Uploading Data 6m
- Demo: Creating Delta Tables Using Apache Spark 5m
- Demo: Exploring Delta Tables 3m
- Demo: Processing Data with Apache Spark 3m
- Demo: Configuring and Starting a SQL Warehouse 4m
- Demo: Running SQL Queries on Delta Tables 2m
- Demo: Visualizing Data Using Databricks SQL 2m
- Summary and Further Study 1m