At Omnicom Media Group India (Annalect), I build and modernize large-scale data platforms for audience and digital advertising datasets across ROW and US markets.
I architect Apache Airflow workflows in Cloud Composer and AWS MWAA, and develop API ingestion pipelines for DV360, SA360, CM360, and Google Ads. These pipelines orchestrate high-volume daily loads into GCP and AWS environments.
I’ve migrated heavy compute workflows to AWS EMR, cutting operational compute costs by 25%, and optimized PySpark and SQL workloads to improve processing efficiency by 30%. I also lead two data developers, enforce coding standards, and implement data quality and anomaly-detection checks that reduced production discrepancies by 20%.
Previously at Tata Consultancy Services, I built Python and Apache Spark data-processing applications, ETL pipelines, and Splunk dashboards and alerts to improve observability and reduce recovery time for pipeline failures.
