At TCS, I design and develop Azure data pipelines for OPTUM’s health insurance datasets, including member enrollment, eligibility, provider, claims and policy data.
I build reusable ingestion frameworks with ADF and Databricks, and transform data into Bronze, Silver and Gold lakehouse layers using PySpark and Delta Lake.
For these pipelines, I implement CDC and incremental loads, SCD Type 1/2, and data-quality checks. I also support near-real-time ingestion with Event Hubs and Spark Structured Streaming.
I apply Unity Catalog governance and tune Spark and Delta workloads to support reliable, traceable data for reporting and downstream analytics. Earlier, I worked in application support, monitoring production applications and batch jobs in the health insurance domain.
