Simple play icon Course
Skills

Create and Monitor Data Pipelines for a Stream Processing Solution

by Ana Voicu

This course will teach you how to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs to process live streaming data.

What you'll learn

Azure gives you all of the resources you need to create and monitor data pipelines and find the data processing solutions you need. In this course, Create and Monitor Data Pipelines for a Stream Processing Solution, you'll learn how to work with stream processing pipelines in Azure in order to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs. First, you'll discover the components of a stream analytics job and why each of them are important. Next, you'll explore how to handle the data coming from the pipeline (insert and update), how to visualize the data in different time windows, and how to troubleshoot such a job. Finally, you'll learn how to improve the performance of your job, by choosing the number of streaming units, parallelizing the query, and using repartitioning to scale your query. By the end of this course, you'll have a better understanding of what it means to create and monitor real-time data processing solutions in Azure.

About the author

Ana Voicu is a seasoned data engineer with a deep passion for databases, business intelligence, and data science. She specializes in developing enterprise-level Business Intelligence solutions across diverse industries, focusing on performance optimization, pattern recognition, efficient business process analysis, and interactive visualizations. Ana thrives on tackling database performance challenges, particularly those involving high data volume applications. Beyond her technical expertise, she... more

Ready to upskill? Get started