At Wipro, I led the migration of 300+ IBM DataStage ETL workflows to PySpark and Hive, focusing on performance, scalability, and cost efficiency. I also developed reusable PySpark frameworks for schema harmonization, safe-type casting, null handling, and dynamic partitioning.
I built data validation and reconciliation checks using SQL to support accurate downstream reporting, and diagnosed pipeline failures with AutoSys, YARN logs, Spark diagnostics, and SQL debugging. I currently work as a Senior Software Engineer at Wipro.
Previously, at Coforge, I analyzed e-commerce and retail customer data for RFM segmentation and personalized marketing. At Lynk, I supported ETL reliability and automated a trip closure process that enabled mass closure of more than 1,000 trips at a time.
