At Tech Mahindra (Tesco Shop), I develop and maintain Azure Data Factory pipelines that bring sales, inventory, and membership data into centralized analytics platforms. I also build transformations with Azure Databricks, PySpark, and Spark SQL.
I implemented SCD Type 2 modeling with Delta Lake and developed Delta Live Tables and Spark Structured Streaming workflows for near-real-time processing. By optimizing SQL and PySpark transformations, I reduced pipeline runtime by approximately 40%.
Earlier, as a Data Engineer Intern at AIML Labs Pvt Ltd, I built Azure data workflows and wrote PySpark transformations and SQL queries for data preparation and validation. I’m Microsoft Certified: Fabric Data Engineer Associate (DP-700).
