Open to opportunities

Muhammad Ahmad

@muhammadahmad27

Message

Lead Data Engineer delivering scalable cloud-native ETL and streaming platforms.

Pakistan

Message

What I'm looking for

I seek a role building scalable cloud data platforms where I can lead engineering teams, optimize systems, and drive automation and cost-efficient architectures.

I am a Lead Data Engineer with 6+ years building scalable, cloud-native data platforms across AWS and GCP, focused on delivering production-grade streaming and batch pipelines.

I design and implement ETL/ELT solutions using PySpark, Airflow, Dagster, Snowflake, EMR, Kinesis and BigQuery, and I drive performance tuning, cost optimization and infrastructure-as-code practices with Terraform.

I mentor engineering teams, enforce code quality, and create learning content — including a top-rated Udemy course on Big Data with PySpark and AWS — to share expertise and accelerate team impact.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Motive

Feb 2023 - Present (2 years 8 months)

Designed and deployed scalable ETL pipelines using Airbyte, Dagster, dbt, and Snowflake, and architected a high-availability data platform with Spark, Kubernetes, and Airflow to improve job success rates and system resilience.

Pyspark Airflow Dagster Snowflake Kubernetes Spark Terraform Kinesis Glue BigQuery

Lead Data Engineer

Walmart x Confiz

Jul 2021 - Jan 2023 (1 year 6 months)

Built and maintained ETL/ML pipelines across Snowflake, GCS, and BigQuery using PySpark and Airflow, and implemented near-real-time ingestion with EMR and Kinesis to support demand forecasting and analytics.

Pyspark Airflow Snowflake BigQuery EMR Kinesis Delta Lake ETL Data Modeling

Data Engineer

NorthBay Solutions

Nov 2019 - Jun 2021 (1 year 7 months)

Developed CDC pipelines replicating RDS to S3 and Snowflake and built Spark streaming/batch jobs using Kinesis and EMR to deliver low-latency analytics and improve pipeline efficiency.

Spark Kinesis EMR Snowflake Redshift Partitioning AWS RDS

Software Engineer

ArbiSoft

Apr 2019 - Oct 2019 (6 months)

Built web scrapers with Scrapy and BeautifulSoup and developed a Django-based inventory system integrated with PySpark and RDS to manage real-time stock and invoicing.