Browsed by
Tag: #athena

Querying CloudTrail Logs from a centralized S3 Location using Athena

Querying CloudTrail Logs from a centralized S3 Location using Athena

Hello! It’s been a while since I posted my last blog post. Today, let’s talk about querying AWS CloudTrail logs that are stored in centralized S3 bucket using AWS Athena. Before getting into the actual topic, let’s quickly mention what are AWS CloudTrail and AWS Athena services. To quote from AWS’s documentation, the purpose of CloudTrail service is to enable governance, compliance, and operational and risk auditing of an AWS account. In simple words, it records all user actions made…

Read More Read More

Covid-19 Analysis with BigData Applications – Part 3

Covid-19 Analysis with BigData Applications – Part 3

Hi there! If you’ve been following these blog series, we are looking at a BigData project to analyze Covid-19 data. So far, we have looked at the overall architecture and ETL Spark jobs. In this post, let’s look the scheduler component (Lambda function) in this workflow. The main reason I’m using Lambda here is due to its serverless nature and native integration with other AWS services. For example, we could trigger it via a CloudWatch scheduled rule in regular basis…

Read More Read More