At HCLTech, I designed and developed ETL/ELT pipelines for HP's Retail Customer Segmentation & Analytics Platform, ingesting data from SQL Server, REST APIs, CSV, and JSON into ADLS Gen2.
I developed reusable Azure Data Factory pipelines and Databricks notebooks using Medallion Architecture and Delta Lake. By optimizing Spark workloads with partitioning, caching, broadcast joins, and query tuning, I reduced processing time by approximately 60%.

