Monitoring and Optimizing Queries in Databricks SQL
This course will teach you to monitor query executions in Databricks SQL, and also regulate access to query objects. You will learn how to optimize query executions with caches, encrypt queries, and configure alerts based on query results.
What you'll learn
Queries lie at the heart of Databricks SQL and managing them correctly will ensure that we make the best use of this platform. In this course, Monitoring and Optimizing Queries in Databricks SQL, you will learn various aspects of query management, from basic administration to encryption, with a special emphasis on query monitoring and optimization. First, you will explore how to create a Delta table and queries which run against it. Next, you will discover how query execution times can be reduced by two different caching mechanisms supported by Databricks SQL - Delta caching and Spark caching. Finally, you will learn how we can monitor the results of query executions and trigger an alert when those results fulfill a specific condition. At the end of this course, you will be well-versed with various aspects of query management, which will help you ensure that your queries are configured correctly, that they run in an optimal manner, and that you are alerted the moment their results point to something that is off.
Table of contents
- Course Prerequisites and Outline 2m
- An Overview of Databricks SQL 2m
- The Need to Monitor Queries 6m
- Demo: Setting up a Databricks Workspace 3m
- Demo: Adding a User to a Databricks Workspace 4m
- Demo: Creating Databricks SQL Queries 5m
- Demo: Granting Access to SQL Queries 4m
- Demo: Granting Access to Databases 6m
- Demo: Regulating Access to Tables 3m
- Demo: Tracking Query Executions 7m
- Demo: Monitoring SQL Endpoint Usage 3m
- Delta Lakes 6m
- Optimizing Delta Tables 4m
- Demo: Viewing Details of Delta Tables 5m
- Demo: Restoring a Delta Table 4m
- Query Caching in Databricks 3m
- Demo: Delta Cache Accelerated Nodes 2m
- Demo: Using Delta Caches 5m
- Demo: Querying Data from a Delta Cache 2m
- Demo: Creating a Spark Cache 5m
- Demo: Testing the Effects of Spark Caching 3m