At Cenit Technologies, I design Azure Data Factory and Databricks pipelines that reduced processing time by 35%. I also implemented Medallion Architecture with CDC and SCD Type 2.
I built metadata-driven ingestion pipelines at NTT DATA using Lakehouse Plumber on Databricks, and developed PySpark readers for Halo Connect REST APIs. I also migrated Alteryx workflows to Databricks and built Kafka streaming pipelines for near-real-time analytics.
At Oomsys, I created ADF pipelines for SharePoint List data that reduced manual effort by 70%. My work also includes data quality checks, Azure Logic Apps notifications, and certifications in Azure and Databricks data engineering.
