Looking for a job

omar sobhy

@omarsobhy

Message

Data Engineer skilled in building efficient data pipelines.

Egypt

Message

What I'm looking for

I seek a dynamic role that fosters innovation and collaboration, allowing me to leverage my data engineering skills to drive impactful solutions.

I am a dedicated Data Engineer with a strong foundation in computer science and artificial intelligence, holding a BSc from Helwan University. My professional journey began with a focus on data analytics, where I developed predictive models and conducted exploratory data analysis to drive business insights. I have a proven track record of enhancing data processing efficiency and ensuring compliance with international standards.

Currently, I work at MNT Halan, where I design and maintain large-scale data pipelines for real-time analytics. My efforts have resulted in a 99.9% pipeline uptime and a 15% reduction in resource consumption. I have successfully led migrations to advanced data platforms, integrating cutting-edge technologies like Kafka streams and Apache Spark to optimize workflows. My experience also includes collaborating with high-profile stakeholders to align data solutions with national priorities.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

MNT Halan

Aug 2023 - Present (2 years 10 months)

Designed and maintained large-scale data pipelines for real-time analytics, ensuring high availability and efficient workflows. Led the migration from MongoDB to Delta Lake and PostgreSQL, integrated Kafka streams, and optimized Apache Airflow DAGs, achieving 99.9% pipeline uptime and reducing resource consumption by 15%.

Data Pipelines Apache Airflow PostgreSQL MongoDB Kafka Scala Apache Spark ETL Data Migration SQL

Data Engineer

Data Science LTD

Jun 2023 - Sep 2023 (3 months)

Led the migration of legacy systems to SAS platforms, enhancing data processing efficiency and ensuring compliance with international regulations. Collaborated with high-profile stakeholders to align data solutions with national priorities and developed reports and dashboards using SAS tools.

SAS Data Processing Compliance Stakeholder Management Reporting Dashboard Development Data Migration Analytics Fraud Detection

Data Analyst Intern

Technocolabs

Jan 2022 - Apr 2022 (3 months)

Developed predictive models for mortgage prepayment forecasting with 96% accuracy using logistic regression. Conducted exploratory data analysis and managed large datasets using SQL, building and deploying machine learning models for real-time insights.