Open to opportunities

Muhammad Khan

@muhammadkhan12

Message

Lead Data Engineer and Cloud Data Architect building scalable lakehouse and real-time data platforms.

United States

Message

What I'm looking for

I seek senior engineering roles building cloud-native lakehouse and real-time data platforms, with strong emphasis on mentorship, scalable architectures, governance, and AI/ML enablement.

I am a Lead Data Engineer and Cloud Data Architect with 9+ years designing scalable enterprise data platforms across healthcare, finance, SaaS, and IoT domains. I specialize in cloud-native lakehouse architectures, real-time streaming pipelines, and modern ETL/ELT ecosystems on AWS, Azure, and GCP.

I've delivered high-availability systems that process hundreds of millions of events daily, improved performance and governance, and reduced cloud costs through migrations and optimization. I built HIPAA-compliant pipelines and promoted data quality and lineage for regulated environments.

My hands-on technical work includes Databricks, Snowflake, Spark, Kafka, dbt, Airflow, Terraform, and CI/CD practices, enabling analytics, AI/ML, and real-time decisioning. I led multi-cloud modernization projects that cut transformation time and infrastructure costs significantly.

I am a mentor and technical leader who modernizes legacy platforms, establishes best practices for cloud architecture and DevOps automation, and enables teams to deliver production-ready, secure data solutions that drive executive decision-making.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

DataFold

Jun 2024 - Present (1 year 9 months)

Architected enterprise-scale cloud-native data platforms on AWS and Azure processing millions of records daily; built real-time streaming ingestion and Snowflake/Databricks lakehouse architectures that reduced data latency from hours to minutes and enabled ML workloads.

Snowflake Databricks Kafka Spark Structured Streaming Airflow DBT Azure Data Factory Data Governance Cloud Architecture

Senior Data Engineer

MedeAnalytics

Oct 2019 - Dec 2023 (4 years 2 months)

Engineered batch and streaming pipelines across multi-terabyte datasets and optimized Snowflake and Azure Synapse environments to support finance and operational reporting, significantly reducing query runtimes and modernizing legacy ETL.

Spark Kafka Snowflake Azure Synapse DBT Airflow Terraform Kubernetes Performance Tuning ELT

ETL & Data Warehouse Engineer

Pact-One Solutions

Mar 2017 - Sep 2019 (2 years 6 months)

Developed enterprise ETL pipelines and dimensional models using SQL Server, Python, SSIS, and Azure Data Factory; implemented near real-time ingestion with Kafka and Spark and improved reporting accuracy via validation and monitoring frameworks.