Section five visualization using Amazon quick site. In this section we will learn the following introduction to Amazon s3. Getting started with Amazon kinases, creating delivery stream with kinases, firehose learning Athena and getting started with Amazon quick site, visualizing the sensor data using Amazon quick site, video 5.1 introduction to Amazon s3. In this video, we will learn the following outline and structure for visualization. What is Amazon s3? Why are they using Amazon s3, creating a bucket in Amazon s3, outline and structure for visualization.
Before visualizing the data with Amazon quick site, we will collect store, process and analyze the data collected here. for collecting the data from IoT Core, I will be using the kinases data firehose. Amazon kinesis data firehose can collect large amounts of data. It also transforms and then loads the data into the data stores and analytic tools. Basically kinesis acts as a pipeline between the data from IoT Core to storage s3 bucket Stoke, using kinases, firehose, the data is transformed into a particular format and then loaded into Amazon s3 bucket, which acts as a data steward. Next, we will analyze this data in Amazon s3 easily using Amazon, Athena, and interactive query service.
A tenant will start querying using standard SQL. In Athena, the data is analyzed in tabular form. Finally, we import this data from Athena to Amazon quick site. In Amazon quick site, we create an analyze widget realizations of the sensor data. As we already know about the data and IoT Core. Let's first learn about the Amazon s3 bucket and then about the pipeline Genesis.
So first, what is Amazon s3. Amazon s3 is a simple storage service that access a cloud storage over the internet. Amazon s3 is a simple web service that allows us to store and retrieve any amount of data at any time from anywhere on the web. It is a highly scalable, reliable, fast, inexpensive data storage infrastructure. This means customers of all sizes and industries can use s3 to store and protect any amount of data. Amazon s3 aims to maximize the benefits of its customers and developers.
So s3 provides us the flexibility to store unlimited data in a cost effective way. You will pay only for what you use the two core components of Amazon s3 bucket and object. Objects are the fundamental entities stored in Amazon s3. Objects consists of object data and metadata. Object data can be anything like images, text, videos, etc. Metadata contains the name value pairs, which will describe the objects.
The buckets are used to store the objects. any object is uniquely identified within a bucket by key name and a version ID. With the data is added to the s3 bucket, then Amazon creates a unique version ID and allocates it to the object. Basically, buckets help us in organizing the data effectively. Next, why are we using Amazon s3. In our project, we are sending the d h 11 sensor data to IoT Core.
This data is stored in an s3 bucket for analyzation. I'm choosing s3 because it's cost effective, secure, easy to manage and also can be active from anywhere at any time, okay, let's create an s3 bucket where we'll store our entire sensor data comm let's start logging into AWS Management Console. Here in find services search for s3, select it. This is the homepage for Amazon s3. Here, select Create bucket, give it a name for your bucket. I'm giving it a data bucket.
Remember, the bucket name must be unique across all the existing bucket names in Amazon s3. If there is already a bucket with the same name, then it will not accept the bucket name can contain only lowercase characters and numbers. made sure that the region where you're creating this bucket and the region in which you created the project must be the same. For me, it's US East North Virginia. Select Create. We have successfully created an Amazon s3 bucket for now.
I'm going to end this video here. In this video, we learned the following outline and structure for visualization. What is Amazon s3? Why are we using Amazon s3, creating a bucket in Amazon s3. In the next video we will get started with Amazon kinesis