At Tata Consultancy Services, I design and maintain Azure Data Factory and Databricks pipelines that ingest daily source data into JSON, Parquet, and Delta Lake layers for reporting workflows. I use PySpark, SQL, and Medallion architecture to turn raw data into consistent bronze, silver, and gold datasets.
I build star-schema fact and dimension tables with Type 2 SCD logic, apply CDC for incremental processing, and automate validation checks with Python. I also monitor SLAs, troubleshoot production failures, and work directly with engineering, business, and client teams in Agile delivery.
