At Insight, I re-architected 20–40+ interdependent SQL views per domain into a governed Bronze/Silver/Gold Delta Lake platform on Azure, ADLS, Databricks, and Unity Catalog. The work cut ETL runtime 40–45% on ~1TB-scale PySpark pipelines.
I improved pipeline performance by applying Adaptive Query Execution, broadcast joins, and caching, and boosted query performance and data reliability by ~30% with Delta Lake OPTIMIZE, Z-Order indexing, and schema evolution. I also orchestrated pipelines with Apache Airflow and enabled real-time ingestion through Apache Kafka.
For marketing analytics, I developed PySpark, Scala, and Spark SQL transformations that turned raw usage data into customer behavior insights adopted org-wide. I also helped lift digital campaign KPIs by 10% through a Power BI and Microsoft Fabric analytics suite.
Earlier, at Headfield Solutions, I cleansed and validated 500M+ records for pricing analytics and built dashboards used by the pricing team. I’ve mentored engineers on Spark performance tuning and coding standards, and hold the Microsoft Certified: Azure Data Engineer Associate (DP-203) certification.
