AWS | Data Engineering | Terraform | Python Automation
Wipro
Built Terraform-driven AWS data platform infrastructure and Python automation for Alight Solutions, supporting governed ingestion, transformation, metadata discovery, analytics delivery, and forecasting workflows.
What I owned
- Reusable Terraform modules for AWS data platform components across S3, Glue, Athena, Redshift, Lambda, Step Functions, and Redis
- Glue/PySpark and SQL-based source-to-target validation, schema checks, null checks, duplicate key checks, and accepted value checks
What changed
- Prepared curated S3 and Redshift datasets for reporting, governance, analytics, and Amazon SageMaker model workflows
- Improved visibility into Glue, S3, Athena, Redshift, and security-related services through CloudWatch and CloudTrail