mustafa atef

I’m a passionate and highly skilled Data Engineer with strong expertise in Python for data engineering, SQL, and ETL processes. I enjoy finding solutions to complex problems using data, and I’m eager to apply proven skills to build real-world data solutions.

In my recent experience as a Data Engineer (Sep 2025 – Jan 2026), I built and maintained a factory database, handled day-to-day factory data, and inserted it into the database. I also built an analytics solution using SSIS.

Before that, I worked as a Quality Assurance Internal Tester (remote), where I gave feedback, submitted daily bug reports, and suggested improvements and new features. This sharpened how I think about reliability, quality, and continuous improvement.

Through academic and training projects, I’ve designed and optimized near real-time and cloud-based pipelines—using Kafka, Spark Structured Streaming, Databricks, and data warehousing approaches. Projects like the NYC Taxi streaming pipeline and large-scale crime data pipeline reflect my drive to deliver practical, scalable data solutions.