At Tata Consultancy Services, I design and maintain Azure Data Factory and Databricks pipelines that process 50–100 GB of sales data daily, with 99.9% pipeline reliability and no SLA breaches. I’ve optimized PySpark and SQL transformations to improve processing performance by about 40%.
I’ve implemented a Delta Lake Medallion architecture with Azure Data Lake Storage Gen2 and Unity Catalog, and strengthened security with RBAC and Azure Key Vault. I’ve also automated deployments with Azure DevOps and built Power BI dashboards to support data quality validation.

