Shubham Wakode

I’m an Azure Data Engineer with 3+ years of experience designing ETL/ELT pipelines on Azure. I specialize in Azure Data Factory, Azure Databricks, PySpark, and Delta Lake, including SSIS-to-ADF migration and implementing SCD Type-2 for daily healthcare data. I’ve built and maintained 15+ ADF pipelines, working with linked services, datasets, data flows, and schedule triggers, with Azure DevOps CI/CD to automate deployments across Dev/Test/Prod.

In my work, I focus on clean transformations and reliable incremental processing, using techniques like watermark columns to avoid full reloads. I’ve written Databricks jobs to clean complex JSON claims data, track patient history with SCD Type-2, and store results in Parquet for fast reporting and audits. On my Oncology Claims platform project, I tuned Databricks for performance, set up ADF triggers with email alerts, and used Azure Key Vault to keep patient data safe, while coordinating validations through Jira and QA.