Collecting Data on AWS
AWS has some of the more comprehensive data collection services in the world. This course will teach you how to leverage various AWS services in accordance with your data collection needs.
What you'll learn
Whenever you’re doing data analytics, the first step is to find a way to collect all the information you want to process. In this course, Collecting Data on AWS, you’ll learn to determine the best ways to ingest your data into AWS. First, you’ll explore how to collect data in AWS over a dedicated network or with hardware appliances. Next, you’ll discover how you can migrate databases using the Database Migration Service (DMS). Finally, you’ll learn how to leverage the Amazon Kinesis family of services, and when each of those is most appropriate. When you’re finished with this course, you’ll have the skills and knowledge of Data Collection on AWS needed to prepare your own data ingestion pipelines.
Table of contents
- Overview 1m
- Kinesis Data Streams Basics 2m
- Kinesis Data Stream Shards and Records 7m
- Producers - The Kinesis Agent 3m
- Producers - The Producer Library 5m
- Producers - AWS SDKs 2m
- Consumers - Client Libraries and Throughput Options 3m
- Consumers - The AWS SDKs and AWS Services 4m
- Demo - Using Kinesis Data Streams with Kinesis Data Analytics 5m
- Creating Our Kinesis Data Stream 4m
- Analyzing Streaming Kinesis Data 7m
- Cleaning up Our Environment 1m
- Summary 1m
- Introduction 1m
- Kinesis Data Firehose - Basic Concepts 6m
- Kinesis Data Firehose - Transformations 4m
- Firehose Producers 4m
- Firehose Destinations - S3 3m
- Firehose Destinations - Amazon ES 3m
- Firehose Destinations - Redshift 3m
- Firehose Destinations - Splunk 2m
- Transforming and Delivering Data with Firehose and Lambda 10m
- Kinesis Firehose vs. Kinesis Data Streams 4m
- Kinesis Firehose vs. Kinesis Data Streams 4m
About the author
Fernando works full time learning the newest trends and tools in application development in order to share them with application developers and architects. Before this, he worked as a Data Engineer at Curalate, where he analyzed data from products used by hundreds of the world's leading visual brands. He also writes frequently about serverless development, and data and security topics. He especially enjoys helping others learn about cloud infrastructure offerings to better support the needs of d... more