At IBM India Pvt. Ltd., I developed data ingestion and transformation pipelines using Apache Spark, PySpark, Scala, and Spark SQL, and designed archival and purging frameworks for Hadoop and AWS S3. I also supported Azure data engineering initiatives involving Azure Databricks and ADLS Gen2.
On the Barclays – LTP project, I designed Azure Data Lakehouse solutions with Azure Data Factory, Azure Databricks, ADLS Gen2, and Delta Lake. Earlier, at TCS and Deloitte USI, I developed and optimized data processing workflows for financial services, retail, and insurance projects, including data quality checks, reconciliation, and production support.

