At Tata Consultancy Services Limited, I designed, built, and maintained ETL pipelines with PySpark and Hadoop for the Equitable-USA project. I also developed end-to-end data products for finance and wealth management, covering ingestion, transformation, and delivery.
I automated batch workflows and built jobs with file and upstream dependency handling. I improved pipeline stability and performance through monitoring, error handling, and Spark job tuning, and delivered Tableau dashboards for reporting and self-service analytics.
At Infosys, I engineered SAP Ariba-to-Azure ETL pipelines for procurement analytics, reducing manual effort by 40% through PySpark and SQL workflows. I also created Tableau dashboards and data validation processes, and conducted quality assurance on Hadoop jobs.
