Open to opportunities

Muneeb Ahmad

@muneebahmad6

Message

Data Engineer specializing in ETL/ELT lakehouse pipelines, streaming with Flink, and production CI/CD on Kubernetes.

Pakistan

Message

What I'm looking for

I’m looking for a Data Engineering role where I can own ETL/ELT and streaming pipelines for lakehouse/data warehouses, improve data quality and performance, and drive production CI/CD and observability on Kubernetes.

I’m a Data Engineer with a BSc in Computer Science, specializing in ETL/ELT pipeline design for open-source lakehouse and data-warehouse architectures on Kubernetes. I build data systems that are reliable, testable, and built for scale.

I’ve architected and deployed a multi-city analytics data lakehouse using a medallion (Bronze/Silver/Gold) ETL/ELT flow, processing 50M+ rows across multiple cities. I automated CI/CD (GitHub Actions → Docker Hub → Kubernetes) and set up monitoring and observability (Prometheus, Grafana, Loki, Marquez), delivering 10+ Apache Superset dashboards and resolving 40+ production issues.

I also develop streaming pipelines, building a Kappa-architecture with Apache Flink using 30-second tumbling windows to keep data latency under 30 seconds. Across projects, I combine Spark, Trino, dbt, Iceberg, and strong data quality practices—so pipelines stay performant and stable in production.

Experience

Work history, roles, and key accomplishments

Self-Directed Data Engineer

Self-Directed Data Engineering Project

Jan 2026 - Apr 2026 (3 months)

Architected and deployed a multi-city Airbnb data lake on a 2-node Kubernetes (k3s) cluster, processing 50M+ rows across 5 cities. Built an ETL/ELT medallion pipeline into a Trino warehouse and automated CI/CD with GitHub Actions, Docker, and Kubernetes while implementing monitoring with Prometheus, Grafana, Loki, and Marquez.

Python Apache Spark Pyspark Medallion (Bronze Silver Gold)Minio Trino DBT Apache Iceberg Kubernetes GitHub Actions Docker CI CD Pipelines Grafana Loki Marquez Apache Superset

Real-Time Streaming Pipeline

Apache Flink

Aug 2025 - Sep 2025 (1 month)

Built a Kappa-architecture streaming pipeline with Apache Flink using 30-second tumbling windows, reducing data latency to under 30 seconds. Developed a dbt project on Snowflake and created a Dagster orchestration project with assets, sensors, and CI/CD automation.

Apache Flink Kappa Architecture Tumbling Window DBT Snowflake Dagster CI CD Automation Data Orchestration