
Aytan Mammadova
@aytanmammadova1
Data Engineer at EPAM Systems building Azure streaming pipelines with Kafka, Spark, and Databricks.
What I'm looking for
At EPAM Systems, I build batch and streaming data pipelines on Azure with Apache Spark and Databricks, using the Medallion architecture and Delta Lake.
I also develop real-time streaming solutions with Kafka and implement incremental ingestion with Spark Structured Streaming and Auto Loader. My work includes infrastructure as code with Terraform and ETL/ELT workflows in PySpark and Spark SQL.
At Digital Umbrella, I led an end-to-end data migration and refactored Apache Airflow pipelines. I also developed SQL queries and Python scripts for reporting, transformation, and validation.
Earlier, I worked on deep learning and machine learning projects, including preparing text datasets for NLP and implementing models to predict housing prices.
Experience
Work history, roles, and key accomplishments
Built batch and streaming data pipelines on Azure with Apache Spark and Databricks, following the Medallion architecture with Delta Lake. Developed real-time streaming solutions with Kafka and implemented Spark Structured Streaming pipelines.
Junior Data Engineer
Digital Umbrella
Nov 2024 - Mar 2026 (1 year 4 months)
Led end-to-end data migration for a new operational term, ensuring data consistency and minimal downtime. Refactored and optimized Apache Airflow ETL pipelines to improve reliability and maintainability.
Deep Learning Intern
Ministry of Justice of Azerbaijan Project
May 2024 - Jul 2024 (2 months)
Optimized tokenizer pipelines used in large language model preprocessing workflows. Cleaned and prepared large-scale textual datasets using Python for NLP tasks.
Deep Learning Intern
Artificial Intelligence Lab
May 2022 - Feb 2023 (9 months)
Implemented deep learning research papers into working Python prototypes. Developed scripts to collect data from multiple sources and prepared datasets for NLP projects.
Artificial Intelligence Intern
E-Government Development Center
Nov 2021 - Feb 2022 (3 months)
Analyzed and cleaned housing datasets for machine learning workflows. Implemented machine learning models to predict housing prices.
Education
Degrees, certifications, and relevant coursework
French-Azerbaijani University
Master of Science, Artificial Intelligence and Data Science
2023 - 2024
Pursued a Master of Science in Artificial Intelligence and Data Science from September 2023 to September 2024.
Azerbaijan Architecture University
Bachelor of Science, Information Technologies
2019 - 2023
Completed a Bachelor of Science in Information Technologies from September 2019 to September 2023.
Anthropic
Claude Certified Architect – Professional, Artificial Intelligence
Earned the Claude Certified Architect – Professional certification in August 2026.
Azerbaijan Project Management Association
IPMA Level D, Project Management
Earned the IPMA Level D certification in August 2022.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Aytan?
You can contact Aytan and 600K+ other talented remote workers on Himalayas.
Message AytanGet matched with your dream remote job
Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
