CloudTrail Partitioner Logo

CloudTrail Partitioner

CloudTrail Partitioner automates the creation and management of partitioned Athena tables for AWS CloudTrail logs with nightly partition updates.

156
Cloud Security
Free
Visit website
0

CloudTrail Partitioner Description

CloudTrail Partitioner is a tool that automates the setup and management of partitioned Amazon Athena tables for AWS CloudTrail logs. The tool creates partitioned tables for each AWS account in the format cloudtrail_000000000000 and generates a unified view that combines all account tables. The solution includes automated nightly partition updates through a CDK (Cloud Development Kit) application that runs at 0600 UTC daily. When deployed manually, it creates 90 days of historical partitions, while the automated nightly process creates partitions for the current day and the following day. The tool is designed to improve query performance and cost efficiency when analyzing CloudTrail logs in Athena by organizing data into time-based partitions. It supports multi-account environments by creating separate tables for each account while providing a consolidated view for cross-account analysis. The project is based on Alex Smolen's work on partitioning CloudTrail logs and is suitable for organizations with moderate CloudTrail log volumes (up to approximately 100GB). For larger scale deployments, the creator recommends using the cloudtrail-parquet-glue project which addresses scalability limitations.

FEATURED

Proton Pass Logo

Password manager with end-to-end encryption and identity protection features

NordVPN Logo

VPN service providing encrypted internet connections and privacy protection

Mandos Fractional CISO Services Logo

Fractional CISO services for B2B companies to accelerate sales and compliance

Stay Updated with Mandos Brief

Get the latest cybersecurity updates in your inbox

POPULAR

RoboShadow Logo

Automated vulnerability assessment and remediation platform

10
TestSavantAI Logo

Security platform that provides protection, monitoring and governance for enterprise generative AI applications and LLMs against various threats including prompt injection and data poisoning.

5
Cybersec Feeds Logo

A threat intelligence aggregation service that consolidates and summarizes security updates from multiple sources to provide comprehensive cybersecurity situational awareness.

5
Fabric Platform by BlackStork Logo

Fabric Platform is a cybersecurity reporting solution that automates and standardizes report generation, offering a private-cloud platform, open-source tools, and community-supported templates.

5
Mandos Brief Newsletter Logo

A weekly newsletter providing cybersecurity leadership insights, industry updates, and strategic guidance for security professionals advancing to management positions.

5
View Popular Tools →