Open to opportunities

Zahra Zaidi

@zahrazaidi

Message

I build scalable lakehouse platforms and reliable healthcare data pipelines.

United States

Message

What I'm looking for

I'm looking to lead scalable data platform and lakehouse initiatives, solve complex reliability and performance challenges, and partner closely with analytics, data science, application, and business teams to deliver trusted data products.

At Kyruus Health, I own key components of a healthcare data platform processing 5TB+ of clinical, claims, EHR, FHIR, and HL7 data daily. I reworked PySpark, dbt, and Airflow pipelines to reduce processing time by 40% and built near-real-time Kafka and Spark Structured Streaming ingestion workflows.

I’ve built AWS and Azure data platforms across Kyruus Health, Metaplane, Hirewell, and Chartio, supporting multi-terabyte analytics, reporting, and machine learning workloads. My work spans Databricks, Spark, Delta Lake, Snowflake, Python, SQL, data modeling, orchestration, governance, and production reliability.

I lead engineers through architecture decisions, code reviews, performance tuning, and production support while partnering with analytics, data science, application, and business teams to deliver governed, dependable data products.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Kyruus Health

Mar 2023 - Present (3 years 6 months)

Owns key components of a Databricks, Apache Spark, Delta Lake, Python, SQL, and AWS healthcare data platform processing 5TB+ of clinical, claims, EHR, FHIR, and HL7 data daily. Reworked high-volume PySpark, dbt, and Airflow pipelines to eliminate processing bottlenecks and improve workload efficiency, reducing overall processing time by 40%.