-
Course
- Data
Monitoring and Optimizing Queries in Databricks SQL
This course will teach you to monitor query executions in Databricks SQL, and also regulate access to query objects. You will learn how to optimize query executions with caches, encrypt queries, and configure alerts based on query results.
What you'll learn
Queries lie at the heart of Databricks SQL and managing them correctly will ensure that we make the best use of this platform. In this course, Monitoring and Optimizing Queries in Databricks SQL, you will learn various aspects of query management, from basic administration to encryption, with a special emphasis on query monitoring and optimization. First, you will explore how to create a Delta table and queries which run against it. Next, you will discover how query execution times can be reduced by two different caching mechanisms supported by Databricks SQL - Delta caching and Spark caching. Finally, you will learn how we can monitor the results of query executions and trigger an alert when those results fulfill a specific condition. At the end of this course, you will be well-versed with various aspects of query management, which will help you ensure that your queries are configured correctly, that they run in an optimal manner, and that you are alerted the moment their results point to something that is off.
Table of contents
- Course Prerequisites and Outline | 1m 56s
- An Overview of Databricks SQL | 2m 16s
- The Need to Monitor Queries | 5m 37s
- Demo: Setting up a Databricks Workspace | 2m 56s
- Demo: Adding a User to a Databricks Workspace | 4m 23s
- Demo: Creating Databricks SQL Queries | 4m 35s
- Demo: Granting Access to SQL Queries | 3m 37s
- Demo: Granting Access to Databases | 5m 47s
- Demo: Regulating Access to Tables | 3m 7s
- Demo: Tracking Query Executions | 6m 56s
- Demo: Monitoring SQL Endpoint Usage | 2m 41s
About the author
An engineer at heart, I am drawn to any interesting technical topic. Big Data, ML and Cloud are presently my topics of interest.
More Courses by Kishan