Serverless ETL/ELT Architecture with S3...

In this post, I will walk through a production-style serverless ETL/ELT architecture on AWS using Amazon S3, Amazon EventBridge, AWS Lambda, AWS Step Functions, and AWS Glue. I will cover the full flow from event-driven ingestion to validation, quarantine handling, orchestration, schema drift handling, data quality checks, and replay. I am intentionally designing this as a pattern that can support both ETL and ELT: ETL when I perform transformations in Glue before landing curated outputs ELT whe