Simple play icon Course
Skills

Developing Spark Applications with Python & Cloudera

by Xavier Morera

Apache Spark is one of the fastest and most efficient general engines for large-scale data processing. In this course, you will learn how to develop Spark applications for your Big Data using Python and a stable Hadoop distribution, Cloudera CDH.

What you'll learn

At the core of working with large-scale datasets is a thorough knowledge of Big Data platforms like Apache Spark and Hadoop. In this course, Developing Spark Applications with Python & Cloudera, you’ll learn how to process data at scales you previously thought were out of your reach. First, you’ll learn all the technical details of how Spark works. Next, you’ll explore the RDD API, the original core abstraction of Spark. Finally, you’ll discover how to become more proficient using Spark SQL and DataFrames. When you’re finished with this course, you’ll have a foundational knowledge of Apache Spark with Python and Cloudera that will help you as you move forward to develop large-scale data applications that enable you to work with Big Data in an efficient and performant way.

Table of contents

Course Overview
1min
Final Takeaway and Continuing the Journey with Spark
11mins

About the author

Xavier has a two passions. He loves the challenge of learning about complex topics and then sharing this newfound knowledge with others. The topics he is currently focused on are AI, ML, Generative AI, Search and Big Data. He is also an entrepreneur, project manager, technical author, trainer, and holds a few certifications with Cloudera, Microsoft, and the Scrum Alliance, along with having been awarted Microsoft MVP. He has spent a great deal of his career working on cutting-edge projects.... more

Ready to upskill? Get started