About This Architecture
Batch ETL data lake pipeline orchestrating daily ingestion, transformation, and analytics using AWS Glue, S3, and Athena. EventBridge triggers a scheduled Glue ETL job that validates and cleanses raw JSONL logs from S3 Raw Bucket, writes cleaned Parquet to S3 Processed Bucket, and catalogs schema in Glue Data Catalog. CloudWatch monitors job execution and alerts, while least-privilege IAM roles isolate Glue and Athena permissions. Athena queries the curated data for daily reporting, serving analytics to BI users with read-only access to processed tiers. This architecture demonstrates medallion lakehouse patterns, cost-efficient Parquet storage, and audit-trail immutability of raw data. Fork and customize this diagram on Diagrams.so to adapt scheduling, add quality gates, or integrate with your data governance framework.