- Lab
- A Cloud Guru
Create an Amazon Kinesis Data Stream Using AWS Cloud9
In this lab, you are playing the role of a Data Engineer currently working for Pluralsight Taxis. You have been given some data that eventually needs to be examined to see which taxi ride fares and starting points are most popular. To start, you will create a Cloud9 instance to send data to a Kinesis Data Stream. You will then use a Kinesis Firehose to extract and load the data into an S3 bucket where it can easily be examined and eventually processed.
Path Info
Table of Contents
-
Challenge
Create an Amazon Kinesis Data Stream
In the console, create a new Kinesis Data Stream named
input-stream
-
Challenge
Create a Data Creation File
Copy the code from the lab.py file from the GitHub repo and paste it into a new file within the Cloud9 instance. Be sure to save it!
https://github.com/pluralsight-cloud/amazon-kinesis-deep-dive/blob/main/Create%20an%20Amazon%20Kinesis%20Data%20Stream%20Using%20AWS%20Cloud9/lab.py
-
Challenge
Send Data to the Kinesis Data Stream and Monitor Progress
- Run the
lab.py
file on the Cloud9 instance. - In the Kinesis section of the console, navigate to the
input-stream
and check the monitoring tab to make sure the data is coming to the stream correctly.
- Run the
-
Challenge
Install Boto3 in the Cloud9 Instance
Use
pip install boto3
to run the python file you just created. -
Challenge
Create a Kinesis Data Firehose and Examine the Output in S3
Create a Kinesis Data Firehose using the previously created
input-stream
as the source and a newly created S3 bucket as the destination. -
Challenge
Create a Cloud9 Instance
Get to the Cloud9 section of the console and create a new cloud9 instance as a T3.micro
What's a lab?
Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.
Provided environment for hands-on practice
We will provide the credentials and environment necessary for you to practice right within your browser.
Guided walkthrough
Follow along with the author’s guided walkthrough and build something new in your provided environment!
Did you know?
On average, you retain 75% more of your learning if you get time for practice.