Open to opportunities

sushant yadav

@sushantyadav

Message

I build Azure data pipelines and analytics datasets using ADF, Databricks, PySpark, and Delta Lake.

India

Message

What I'm looking for

I'm looking to build and support scalable Azure data solutions, including ETL/ELT pipelines, Databricks processing, Delta Lake architectures, and business-ready analytics datasets.

At Tata Consultancy Services, I developed and supported end-to-end cloud data pipelines using Azure Data Factory, Azure SQL Database, ADLS Gen2, Databricks, Python, and PySpark.

I built ingestion, transformation, migration, and incremental-loading workflows, including watermark-based processing and validation. I also processed structured and semi-structured data with Apache Spark DataFrames, PySpark transformations, joins, aggregations, filtering, deduplication, and cleansing.

I implemented Bronze, Silver, and Gold data layers with Medallion Architecture and Delta Lake, producing curated datasets for Power BI reporting and downstream analytics.

I support production data operations through monitoring, troubleshooting, validation, reconciliation, incident management, and root cause analysis. I also use Azure DevOps and Git for source control, branching, and basic CI/CD activities.

Experience

Work history, roles, and key accomplishments

Azure Data Engineer

Tata Consultancy Services

May 2022 - Dec 2025 (3 years 7 months)

Developed and supported end-to-end data pipelines using Azure Data Factory, Azure SQL Database, ADLS Gen2, Databricks, Python, and PySpark. Implemented Medallion Architecture with Delta Lake and performed production support including monitoring, troubleshooting, and RCA.