Vaishnavi Darunte

I’m a globally certified Azure Data Engineer with 1.10+ years of experience designing and building scalable ETL/ELT pipelines for enterprise data platforms. I use Microsoft Fabric, Azure Data Factory, Azure Databricks, PySpark, and Delta Lake to deliver analytics-ready datasets.

In my current role, I designed and deployed ETL/ELT pipelines in Azure Data Factory to ingest data and flat files into ADLS Gen2. I developed optimized data transformation workflows in Azure Databricks with PySpark for large-scale processing, and built Delta Lake tables with ACID compliance and schema enforcement.

I focus on performance and reliability: I enhanced pipeline performance using Spark optimization, partitioning strategies, and query tuning. I also monitored and resolved pipeline issues to maintain high data quality, reliability, and system availability.

On the project side, I implemented an end-to-end Healthcare Data Lakehouse using Azure Data Factory, ADLS Gen2, and Azure Databricks. I executed Medallion Architecture with Delta Lake, built parameterized ingestion pipelines, handled nested JSON API data via JSON flattening and schema evolution, and delivered analytics-ready curated outputs with Unity Catalog and Delta optimizations.