Save 50% on a year of our new Complete plan. Use code FLASH50 at checkout. Get started
close button
  • Course
    • Libraries: If you want this course, consider one of these libraries.
    • Data

Scalable Data Processing with Python

Learn to process large-scale data efficiently with Python. This course will teach you to leverage PySpark and Dask for scalable, parallel, and distributed data processing, and to optimize performance and handle real-world scaling challenges.

Yasir Khan - Pluralsight course - Scalable Data Processing with Python
by Yasir Khan

What you'll learn

Scalable data processing is essential for handling large datasets efficiently, yet many struggle with optimizing performance.

In this course, Scalable Data Processing with Python, you’ll gain the ability to process and manage large-scale data using PySpark and Dask.

First, you’ll explore the fundamentals of scalability, including parallel, distributed, and batch processing.

Next, you’ll discover how to use PySpark to process massive datasets with transformations, caching, and optimizations.

Finally, you’ll learn how to leverage Dask for parallel computation, optimizing execution with task graphs and lazy evaluation.

When you’re finished with this course, you’ll have the skills and knowledge to efficiently process large datasets and handle performance challenges in scalable data processing.

Table of contents

About the author

Yasir Khan - Pluralsight course - Scalable Data Processing with Python
Yasir Khan

Dr. Yasir Khan is a global tech consultant and 38Labs founder. He's passionate about digital transformation, data & AI, and regularly shares technology insights on Pluralsight.

More Courses by Yasir