Zafer Eqbal

I'm building large-scale Azure data engineering pipelines for Humana at Wipro, processing high-volume healthcare data through batch, real-time, and Kafka-based ingestion workflows. I use PySpark, Databricks, Azure Data Factory, Delta Live Tables, and ADLS Gen2 to deliver reliable data to data warehouse and MFT destinations.

I improved query performance by approximately 45% through Spark and Delta optimization, including partitioning, file compaction, auto-optimization, and performance tuning. I also improved streaming stability by approximately 30% through watermarking and state-store management.

Previously at Virtusa, I built ingestion and processing platforms for Anthem, unifying claims, member activity, provider network, and customer service data for analytics and reporting. I reduced batch runtime by 65% using partition pruning, broadcast joins, and Spark memory tuning.

I enjoy solving mathematics and programming problems and learning new technologies. My work centers on scalable, governed, analytics-ready data platforms using Medallion Architecture, Delta Lake, and production-grade streaming pipelines.