Open to opportunities

Rukh Zahra

@rukhzahra

Lead Data Engineer building HIPAA-compliant healthcare lakehouses and governed batch/streaming pipelines on Databricks and AWS.

United States

Message

What I'm looking for

I’m looking to build and modernize governed data platforms—especially cloud-native lakehouses and batch/streaming pipelines—where I can help teams ship trusted analytics-ready data products and AI-ready datasets with strong automation, quality, and HIPAA-grade compliance.

I lead data engineering at Kyruus Health, designing a cloud-native healthcare lakehouse on Databricks with Apache Spark, Delta Lake, Unity Catalog, and AWS S3 to process 5TB+ of FHIR, HL7, EHR, and claims data daily. I’ve built batch and streaming pipelines for 200+ downstream datasets, plus a governed Medallion Lakehouse enabling secure access for 150+ analytics and business users.

I focus on trust and automation—using Unity Catalog, Great Expectations, dbt tests, and Monte Carlo to keep data HIPAA-compliant, and using Terraform, Docker, Amazon EKS, Helm, and GitHub Actions to streamline infrastructure and CI/CD. Previously at Metaplane, I developed scalable pipelines with Spark, Azure Data Factory, and Microsoft Fabric, and earlier at Hirewell and Chartio I built ETL/ELT workflows with strong data quality and orchestration.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Kyruus Health

Mar 2023 - Present (3 years 5 months)

Led design of cloud-native healthcare lakehouse on Databricks processing 5TB+ of FHIR, HL7, EHR, and claims data daily. Built scalable batch and streaming pipelines reducing processing time by 40%.

Apache Spark Delta Lake Unity Catalog Databricks Great Expectations DBT Monte Carlo Terraform Docker Kubernetes Helm GitHub Actions BigQuery Pub Sub Dataflow

Senior Data Engineer

Metaplane

Nov 2019 - Feb 2023 (3 years 3 months)

Designed scalable batch and streaming data pipelines using Python, SQL, Apache Spark, Azure Data Factory, and Microsoft Fabric. Built distributed data processing solutions improving transformation performance by 30%.

Python SQL Apache Spark Azure Data Factory Microsoft Fabric Databricks ADLS Snowflake Jenkins Power BI Tableau Looker

Data Engineer

Hirewell

Sep 2016 - Oct 2019 (3 years 1 month)

Developed scalable ETL pipelines using Python, SQL, Azure Data Factory, Apache Spark, integrating enterprise applications and diverse data sources. Processed over 1TB of enterprise datasets for analytics.

Python SQL Azure Data Factory Apache Spark Azure Synapse Data Vault REST APIs

Junior Data Engineer

Chartio

Jul 2014 - Aug 2016 (2 years 1 month)

Assisted developing ETL workflows using Python, SQL, Azure Data Factory, supporting enterprise reporting and centralized analytics initiatives. Developed optimized datasets for Power BI and Tableau.

Python SQL Azure Data Factory Apache Spark Hadoop Azure Synapse Power BI Tableau