Skip to content

Contact sales

By filling out this form and clicking submit, you acknowledge our privacy policy.
  • Labs icon Lab
  • A Cloud Guru
Google Cloud Platform icon
Labs

Create an Amazon Kinesis Data Stream Using AWS Cloud9

In this lab, you are playing the role of a Data Engineer currently working for Pluralsight Taxis. You have been given some data that eventually needs to be examined to see which taxi ride fares and starting points are most popular. To start, you will create a Cloud9 instance to send data to a Kinesis Data Stream. You will then use a Kinesis Firehose to extract and load the data into an S3 bucket where it can easily be examined and eventually processed.

Google Cloud Platform icon
Labs

Path Info

Level
Clock icon Beginner
Duration
Clock icon 45m
Published
Clock icon Dec 27, 2023

Contact sales

By filling out this form and clicking submit, you acknowledge our privacy policy.

Table of Contents

  1. Challenge

    Create an Amazon Kinesis Data Stream

    In the console, create a new Kinesis Data Stream named input-stream

  2. Challenge

    Create a Data Creation File

    Copy the code from the lab.py file from the GitHub repo and paste it into a new file within the Cloud9 instance. Be sure to save it! https://github.com/pluralsight-cloud/amazon-kinesis-deep-dive/blob/main/Create%20an%20Amazon%20Kinesis%20Data%20Stream%20Using%20AWS%20Cloud9/lab.py

  3. Challenge

    Send Data to the Kinesis Data Stream and Monitor Progress

    • Run the lab.py file on the Cloud9 instance.
    • In the Kinesis section of the console, navigate to the input-stream and check the monitoring tab to make sure the data is coming to the stream correctly.
  4. Challenge

    Install Boto3 in the Cloud9 Instance

    Use pip install boto3 to run the python file you just created.

  5. Challenge

    Create a Kinesis Data Firehose and Examine the Output in S3

    Create a Kinesis Data Firehose using the previously created input-stream as the source and a newly created S3 bucket as the destination.

  6. Challenge

    Create a Cloud9 Instance

    Get to the Cloud9 section of the console and create a new cloud9 instance as a T3.micro

The Cloud Content team comprises subject matter experts hyper focused on services offered by the leading cloud vendors (AWS, GCP, and Azure), as well as cloud-related technologies such as Linux and DevOps. The team is thrilled to share their knowledge to help you build modern tech solutions from the ground up, secure and optimize your environments, and so much more!

What's a lab?

Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.

Provided environment for hands-on practice

We will provide the credentials and environment necessary for you to practice right within your browser.

Guided walkthrough

Follow along with the author’s guided walkthrough and build something new in your provided environment!

Did you know?

On average, you retain 75% more of your learning if you get time for practice.

Start learning by doing today

View Plans