At Wipro, I designed AWS Glue pipelines with automated S3 file-availability checks, reducing manual intervention by 90%. I also engineered approximately 390 Glue jobs and pipelines processing around 150–160 GB of data across recurring workflows.
At Searce Cosourcing Pvt. Ltd., I migrated 100+ Apache Airflow DAGs from GCP Cloud Composer to AWS MWAA and worked on data migrations from RDS MySQL, Greenplum, and BigQuery to Amazon Redshift. I also built an event-driven streaming pipeline using AWS Kinesis Data Streams, SQS, and Lambda.
At Ugam Solutions Pvt. Ltd., I developed PySpark and Spark SQL jobs in Databricks for campaign analytics and supported near-real-time CDC workloads across 5TB+ datasets. I also automated AWS cluster operations and migrated an on-premises MySQL database to Amazon RDS.
