Path icon Learning Paths
Skills

Stream Processing with Apache Spark Structured Streaming and Azure Databricks

  • Number of Courses6 courses
  • Duration15 hours
  • Skill IQ available Skill IQ

Streaming data is used to make decisions and take actions in real time. The processing of streaming data must support these virtually immediate results, by the stateful analysis of multiple events over a period within one or multiple data streams. It must also support the joining of streaming data with data at rest in databases. The purpose of this skill is to teach you how to process streaming data using Apache Spark with Azure Databricks.

Courses in this path

Beginner

Understand the processing model for streaming data, as implemented in Apache Spark Structured Streaming.

Modeling Streaming Data for Processing with Apache Spark Structured Streaming

  • by Eugene Meidinger
  • 1h 19m Duration
  •  (13)

Conceptualizing the Processing Model for Apache Spark Structured Streaming

  • by Janani Ravi
  • 2h 57m Duration
  •  (20)

Intermediate

Build a streaming data processing pipeline using Apache Spark Structured Streaming.

Exploring the Apache Spark Structured Streaming API for Processing Streaming Data

  • by Janani Ravi
  • 2h 49m Duration
  •  (22)

Processing Streaming Data Using Apache Spark Structured Streaming

  • by Janani Ravi
  • 2h 35m Duration
  •  (21)

Advanced

Apply your streaming data knowledge inside of Azure Databricks.

Conceptualizing the Processing Model for Azure Databricks Service

  • by Mohit Batra
  • 2h 51m Duration
  •  (48)

Handling Streaming Data with Azure Databricks Using Spark Structured Streaming

  • by Mohit Batra
  • 2h 28m Duration
  •  (29)

Learn with the best

Eugene Meidinger
Eugene Meidinger
Eugene Meidinger works as an independent BI consultant and Pluralsight author, specializing in Power BI and the Azure Data Platform. He has been working with data for over 8 years and speaks regularly at user groups and conferences. He also helps run the GroupBy online conference.
Janani Ravi
Janani Ravi
Janani has a Masters degree from Stanford and worked for 7+ years at Google. She was one of the original engineers on Google Docs and holds 4 patents for its real-time collaborative editing framework. After spending years working in tech in the Bay Area, New York, and Singapore at companies such as Microsoft, Google, and Flipkart, Janani finally decided to combine her love for technology with her passion for teaching. She is now the co-founder of Loonycorn, a content studio focused on providing ... more
Mohit Batra
Mohit Batra
Mohit is a Data Engineer, a Microsoft Certified Trainer (MCT) and a consultant. Mohit has 15+ years of extensive experience in architecting large scale Business Intelligence, Data Warehousing and Big Data solutions with companies like Microsoft and some leading investment banks. As an expert in his field, Mohit has often shared his knowledge in Azure, Spark, SQL Server and Power BI at various public forums and as a corporate trainer. Mohit truly loves to teach and enjoys producing high-quality,... more

Join our learners and upskill
in leading technologies