Querying Data in Amazon S3 with Amazon Athena

• Database: aws_service_logs
• Table Name: cf_access_optimized
• Location of Input Data Set: s3://<S3_BUCKET_NAME>/
• Data Format: Parquet

time timestamp, location string, bytes bigint, requestip string, method string, host string, uri string, status int, referrer string, useragent string, querystring string, cookie string, resulttype string, requestid string, hostheader string, requestprotocol string, requestbytes bigint, timetaken double, xforwardedfor string, sslprotocol string, sslcipher string, responseresulttype string, httpversion string

• Column Name: year
• Column Name: month
• Column Name: day

Open a new query tab.

Run the following query:

MSCK REPAIR TABLE aws_service_logs.cf_access_optimized

Observe that the row count equals 207535 with the following query:

SELECT count(*) AS rowcount FROM aws_service_logs.cf_access_optimized

Verify the partitions were created with the following query:

SELECT * FROM aws_service_logs.cf_access_optimized order by time desc LIMIT 10

Observe the bytes column from the following query:

SELECT * FROM aws_service_logs.cf_access_optimized WHERE time BETWEEN TIMESTAMP '2018-11-02' AND TIMESTAMP '2018-11-03'

Run the following query:

SELECT SUM(bytes) AS total_bytes
FROM aws_service_logs.cf_access_optimized
WHERE time BETWEEN TIMESTAMP '2018-11-02' AND TIMESTAMP '2018-11-03'

Observe the value for total_bytes equals 87310409.