Hamburger Icon
  • Course
    • Libraries: If you want this course, consider one of these libraries.
    • Data

Monitoring and Optimizing Queries in Databricks SQL

This course will teach you to monitor query executions in Databricks SQL, and also regulate access to query objects. You will learn how to optimize query executions with caches, encrypt queries, and configure alerts based on query results.

Kishan Iyer - Pluralsight course - Monitoring and Optimizing Queries in Databricks SQL
by Kishan Iyer

What you'll learn

Queries lie at the heart of Databricks SQL and managing them correctly will ensure that we make the best use of this platform. In this course, Monitoring and Optimizing Queries in Databricks SQL, you will learn various aspects of query management, from basic administration to encryption, with a special emphasis on query monitoring and optimization. First, you will explore how to create a Delta table and queries which run against it. Next, you will discover how query execution times can be reduced by two different caching mechanisms supported by Databricks SQL - Delta caching and Spark caching. Finally, you will learn how we can monitor the results of query executions and trigger an alert when those results fulfill a specific condition. At the end of this course, you will be well-versed with various aspects of query management, which will help you ensure that your queries are configured correctly, that they run in an optimal manner, and that you are alerted the moment their results point to something that is off.

Table of contents

About the author

Kishan Iyer - Pluralsight course - Monitoring and Optimizing Queries in Databricks SQL
Kishan Iyer

An engineer at heart, I am drawn to any interesting technical topic. Big Data, ML and Cloud are presently my topics of interest.

More Courses by Kishan