Illia F
@illiaf
Experienced Data Engineer with expertise in Big Data and ETL processes.
What I'm looking for
With over 10 years of experience in data engineering, I have honed my skills in processing data using both scripting and ETL tools. My expertise lies in Big Data and MPP systems, where I have successfully managed end-to-end data integration processes. I am proficient in SQL and Python, and I have extensive cloud experience with AWS, which has allowed me to design and implement efficient ETL/ELT processes.
In my current role as a Big Data Engineer and Data Lead at Coherent Solutions, I lead the integration of data from various sources and manage Spark jobs to optimize performance. My previous experience at Easybrain and IBA Group has equipped me with a strong foundation in developing and maintaining ETL processes, as well as training and mentoring teams. I am passionate about leveraging my skills to drive business growth and enhance data capabilities.
Experience
Work history, roles, and key accomplishments
Big Data Engineer
Coherent Solutions
Mar 2020 - Present (5 years 3 months)
Led the integration of data from internal systems and third-party sources, ensuring seamless data flow and accuracy. Orchestrated, managed, and fine-tuned Spark jobs to optimize performance and efficiency. Utilized a robust tech stack including Spark, Python, SQL, Azkaban, Hive, AWS, Jenkins, Presto, and ReDash to execute data engineering tasks effectively.
Data Lead
Coherent Solutions
Sep 2020 - Sep 2021 (1 year)
Provided valuable insights to update and enhance existing infrastructure, driving continuous improvement initiatives. Developed comprehensive migration plans for transitioning services to new infrastructure, ensuring minimal disruption. Led and mentored an analytics team, fostering collaboration and knowledge sharing to achieve departmental goals.
Data Engineer, Scrum Master
IBA Group
Jul 2016 - Oct 2018 (2 years 3 months)
Led an internal Proof of Concept project as a Hadoop Engineer, introducing Scrum methodology and developing ETL and machine learning algorithms using Apache Spark. Provided numerous data integrations as an ETL Developer using tools like Informatica and DataStage, along with programming languages such as Java, Perl, and Python. Conducted onboarding Unix courses and administered internal services, d
Data Engineer
Intent
Mar 2024 - Present (1 year 3 months)
Worked as a single Data Engineer on a startup project related to health, fitness and habits. Helped to solve critical data-related issues and establish data engineering processes. Created data processing architecture for new features and implemented it, while also conducting several data-related analyses and providing insights.
Data Engineer
Easybrain
Nov 2018 - Aug 2019 (9 months)
Played a key role in the BI team responsible for data gathering and provision to various internal teams. Developed and maintained ETL processes, facilitating seamless data loading from S3 to ClickHouse and Postgres databases. Engineered a data generator for applications utilizing PySpark on EMR clusters, significantly decreasing overall runtime.
DB Developer, Tech Support
Bamboo Group OU
Apr 2015 - Mar 2016 (11 months)
Contributed to mobile application development, focusing on data modeling, database design, and payment data analysis. Ensured data availability and integrity by writing and optimizing database queries and procedures. Managed technical support activities, resolving customer issues and conducting database processing and analysis.
Education
Degrees, certifications, and relevant coursework
Belarusian State University of Informatics and Radioelectronics
Bachelor's degree, Automated Systems of Information Processing
Obtained a Bachelor's degree in Automated Systems of Information Processing. This program provided a foundational understanding of information systems and their automated processes.
Belarusian State University of Informatics and Radioelectronics
Master's degree, System Analysis, Management, and Information
Completed a Master's degree in System Analysis, Management, and Information. This advanced program focused on comprehensive system analysis, management principles, and information handling.
Availability
Location
Authorized to work in
Job categories
Interested in hiring Illia?
You can contact Illia and 90k+ other talented remote workers on Himalayas.
Message IlliaFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
