Skip to content

Contact sales

By filling out this form and clicking submit, you acknowledge our privacy policy.
  • Labs icon Lab
  • A Cloud Guru
Google Cloud Platform icon
Labs

Storing Data in S3 Using Kinesis Data Firehose

In this Hands on Lab you will gain experience working as a Data Engineer to create a Kinesis Data Firehose stream that moves data into an S3 bucket that you will create. Once created you will learn how to test the stream with demo data, and then create alerts that will enable you to monitor your streams once they become production ready.

Try for free Contact sales
Google Cloud Platform icon
Labs

Path Info

Level
Clock icon Advanced
Duration
Clock icon 30m
Published
Clock icon May 24, 2024

Contact sales

By filling out this form and clicking submit, you acknowledge our privacy policy.

Table of Contents

  1. Challenge

    Configure your Data Stream

    1. Create an Amazon Data Firehose
    2. Select Kinesis Data Streams as the source Create a new Kinesis Data Stream named "ml-kinesis-stream-1
    3. Select S3 as the destination Create a new S3 bucket for the destination
    4. Complete the Firehose Stream creation.

  2. Challenge

    Test Kinesis Data Stream

    1. Send demo data to the S3 bucket for approximately 5 minutes.
    2. End the Stream
    3. Confirm that data has been streamed to S3
    4. Review metrics in Firehose and confirm successful capture of data

  3. Challenge

    Create an Alert

    1. Create an alarm that will trigger if Records read from Kinesis Data streams drops below 10,000 in one minute.
    2. Create a new topic that you can send to a [email protected] email or your own email if you prefer.
    3. Resend 5 minutes of test data to confirm alarm.
A Cloud Guru - Labs - Storing Data in S3 Using Kinesis Data Firehose
Author
A Cloud Guru

The Cloud Content team comprises subject matter experts hyper focused on services offered by the leading cloud vendors (AWS, GCP, and Azure), as well as cloud-related technologies such as Linux and DevOps. The team is thrilled to share their knowledge to help you build modern tech solutions from the ground up, secure and optimize your environments, and so much more!

What's a lab?

Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.

Provided environment for hands-on practice

We will provide the credentials and environment necessary for you to practice right within your browser.

Guided walkthrough

Follow along with the author’s guided walkthrough and build something new in your provided environment!

Did you know?

On average, you retain 75% more of your learning if you get time for practice.

Start learning by doing today

View Plans