Advanced Data and Stream Processing with Microsoft TPL Dataflow
CPUs have more and more cores, but writing parallel programs is tricky. In this course, you will learn how the data flow programming model combined with the actor model makes writing high performance, large data-processing systems easy.
What you'll learn
Writing a highly parallel application is tricky, but it doesn't have to be; with the proper tools it can be significantly simplified. In this course, Advanced Data and Stream Processing with Microsoft TPL Dataflow, you will learn how to take advantage of both the data flow programming model and the actor model implemented in Microsoft TPL Dataflow to write systems capable of quickly processing hundreds of gigabytes of data. First, you will explore the architectural principles of TPL Dataflow, including some of the pitfalls of abstraction over executed code-blocks. Next, you will use blocks to construct production-grade workflows with proper error handling and monitoring. Finally, you will learn how the imperative approach to execution logic makes parallelizing and performance optimization a breeze. Finishing this course will give you a unique tool to write systems that can handle large amounts of data, or even just high-performance systems that take advantage of all the processing power available on the machine without sacrificing code readability and reuse.
Table of contents
About the author
With .NET from version 1.1 and with web development from the time when IE6 was the "better" browser. By day, a leader of an R&D department, by night a proud developer of cookit.pl - a pet project processing hundred of gigabytes of data with whatever suits the problem best (Graph databases/ML/C#/F#). Technology enthusiast, Neo4j ambassador, speaker, and blogger at IndexOutOfRange.com