Open to opportunities

Misbah Yaseen

@misbahyaseen

Senior data engineer building scalable ETL, streaming pipelines, and production ML/analytics on Azure and cloud platforms.

Zimbabwe

Message

What I'm looking for

I’m looking for a senior data engineering role where I can build scalable ETL and streaming pipelines, automate data quality and reporting, and ship production analytics/ML workflows across modern cloud platforms with strong engineering standards.

I’m a senior data engineering specialist who designs, builds, and optimizes large-scale data systems—from reliable ETL to cloud-native data platforms. I focus on turning raw data into trusted, actionable insights for analytics and ML workflows in production.

In my current role, I’ve built scalable ETL pipelines integrating Microsoft Fabric with modern warehouses and storage (including Snowflake, BigQuery, Redshift, Delta Lake, Parquet, and ORC). I’ve also developed data processing workflows across AWS, GCP, and Azure to support real-time recommendation and personalization systems.

I love production-grade automation. I improved reporting workflows using dbt and automated summarization, reducing manual reporting by 42%, and I designed a streaming bandit experimentation engine handling 5M+ events weekly with Kafka and Spark Structured Streaming.

Earlier, I built batch and streaming pipelines in PySpark and Delta Lake and created dashboards and validation processes using SQL and automation—improving reporting efficiency by 30%. I bring that same engineering mindset to collaboration, data quality, and orchestration so teams can move faster with confidence.

Experience

Work history, roles, and key accomplishments

Current

Snr. Data Engineer

Current

PRYPCO

Nov 2023 - Present (2 years 8 months)

Designed and implemented scalable ETL pipelines integrating Microsoft Fabric to support real-time recommendation and personalization systems. Built automated reporting with dbt and streaming experimentation pipelines for bandit-based A/B ML using Kafka and Spark.

PySpark Microsoft Fabric Azure Synapse Snowflake Delta Lake Amazon Redshift PostgreSQL MySQL Parquet ORC DBT Crew AI Kafka Spark Structured Streaming MLFlow Data Vault AWS S3 Lambda EC2 EMR GCP Dataflow Vertex AI BigQuery

Data Engineer

StyleSeat

Sep 2021 - Nov 2023 (2 years 2 months)

Built batch and streaming data pipelines using PySpark and Delta Lake to support analytics and BI workflows. Implemented automated data quality checks and CI/CD with cloud and container tooling, and created dashboards for efficient querying.

PySpark Delta Lake Tableau Power BI Looker R Shiny Superset Azure DevOps Docker Kubernetes GitHub Python SQL Jenkins GitHub Actions Data Quality JupyterLab Jira

Software Engineer - Data Projects

StyleSeat

Jun 2020 - Sep 2021 (1 year 3 months)

Engineered an AI document automation workflow and built a multi-agent LLM system with dynamic routing and parallel execution. Developed ML retraining pipelines and NLP preprocessing pipelines in Python and Spark for large-scale text extraction and indexing.

Parquet Delta Dynamic Section Routing Sagemaker Python PySpark Spark Real Time Transcription Pipelines STT Engine Indexing

Data Analyst

Upwork

Jun 2019 - May 2020 (11 months)

Created SQL-based ETL workflows to clean and validate sales and marketing data. Built Excel and Power BI reports from structured models and supported A/B test evaluation decision-making with automated scripts.