Dastan Abirayev
@dastanabirayev
Data Engineer with expertise in scalable data platforms and automation.
What I'm looking for
I am a Data Engineer with over 4 years of experience in designing and implementing scalable data platforms and backend systems. My proficiency in Python, SQL, and T-SQL, combined with hands-on expertise in Azure Synapse Analytics and Azure Data Factory, allows me to build and optimize ETL/ELT pipelines that support high-quality analytics and reporting.
Throughout my career, I have successfully led projects that improved data processing times and operational efficiency. For instance, at Netpeak, I designed ETL pipelines that processed over 10 TB of data monthly and migrated legacy workflows to modern solutions, enhancing processing speed by 40%. My experience also includes developing machine learning workflows and automating complex data processes using no-code tools, which significantly reduced manual intervention.
I am passionate about leveraging data to drive business insights and am always eager to collaborate with cross-functional teams to translate business requirements into actionable data solutions. My goal is to continue growing in the field of data engineering while contributing to innovative projects that harness the power of data.
Experience
Work history, roles, and key accomplishments
Data Engineer
Netpeak
May 2022 - Present (3 years 3 months)
Designed and deployed scalable ETL/ELT pipelines using Azure Data Factory and PySpark, processing over 10 TB of structured and semi-structured data monthly. Led the migration from legacy SSIS-based workflows to modern Azure Synapse Analytics pipelines, improving data processing time by 40%.
Data Engineer
Ilink Professionals Inc
Apr 2022 - Apr 2023 (1 year)
Engineered Snowflake-based data warehouses by supporting data modeling, ETL automation, and metadata management in collaboration with senior architects. Implemented data integration workflows using Azure Data Factory and Azure Synapse Analytics to enable seamless data ingestion into Snowflake.
Education
Degrees, certifications, and relevant coursework
Nanjing University of Information Science and Technology
Bachelor’s Degree, Computer Science
2018 - 2022
Completed a Bachelor's Degree in Computer Science. Gained foundational knowledge in computer science principles and practices.
Tech stack
Software and tools used professionally
Postman
Azure Synapse
Azure Storage
GitHub
Kubernetes
Jenkins
GitHub Actions
NumPy
Pandas
PySpark
dbt
PostgreSQL
Gmail
NestJS
Tailwind CSS
Databricks
Puppeteer
Terraform
AWS CloudFormation
Azure DevOps
Mocha
Chai
SuperTest
Azure Machine Learning
TensorFlow
PyTorch
Keras
Datadog
Firebase
AWS Lambda
Serverless
pytest
BeautifulSoup
Zapier
Airflow
SQL
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Dastan?
You can contact Dastan and 90k+ other talented remote workers on Himalayas.
Message DastanFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
