At Data Hatch, I’m developing an Azure Databricks healthcare claims lakehouse that replaces a spreadsheet-driven quarterly reporting process. It ingests a 700+ object on-premises SQL Server system and refines the data through Bronze, Silver, and Gold layers.
I re-architected incremental ingestion around Delta Change Data Feed, removing nightly full reloads on nearly half of the tables. I also implemented soft-delete propagation, idempotent MERGE logic, and a Silver-to-Gold data quality gate with reconciliation logging.
At Digital Remedy, I developed and maintained Azure Databricks and Delta Lake pipelines for digital marketing analytics and attribution. I optimized Spark workloads and delivered curated advertiser- and campaign-level reporting datasets.
At Zielotech Software PVT. LTD., I built PySpark and Spark SQL ETL pipelines on Azure Databricks and orchestrated ingestion with Azure Data Factory. I also automated on-premises data migration to Google Cloud Storage with Apache Airflow and prepared analytical datasets in BigQuery.
