Open to opportunities

Valentin Magdić

@valentinmagdi

Message

Experienced data engineer specializing in Elasticsearch and big data solutions.

Croatia

Message

What I'm looking for

I am looking for a role that challenges me with complex data problems, offers opportunities for growth, and fosters a collaborative team environment.

I am a seasoned data engineer with over 13 years of programming experience, including more than 7 years in a professional capacity. My expertise lies in data engineering, search infrastructure, and big data solutions, with a strong focus on Elasticsearch, ETL pipelines, and large-scale distributed systems. I thrive on solving complex data challenges and enjoy building data pipelines, optimizing search systems, and leveraging machine learning for analytics and insights.

Throughout my career, I have achieved significant milestones, such as managing the largest European Elasticsearch cluster and optimizing its performance at scale. I have also built an on-premise Spark cluster on Ceph and designed numerous ETL pipelines using various frameworks. My passion for data drives me to continuously seek knowledge in AI, search optimization, and large-scale data processing, while I actively work on personal data projects in my free time.

Experience

Work history, roles, and key accomplishments

Current

Elasticsearch Consultant

Current

OpenSourceConnections

Apr 2024 - Present (1 year 1 month)

Provided on-demand consulting services to clients, focusing on optimizing and scaling Elasticsearch clusters for high-performance search workloads. Enhanced search relevancy, query performance, and indexing strategies while offering technical guidance and best practices for Elasticsearch implementation.

Elasticsearch Performance Indexing Technical Consulting Scalability Performance Tuning

Elasticsearch Consultant/Data Engineer

Zalando

May 2024 - Nov 2024 (6 months)

Analyzed and enhanced search infrastructure and performance, ensuring scalability and reliability for high-traffic workloads. Developed and automated data pipelines to streamline processing and ingestion, and monitored search and data systems to ensure stability.

Elasticsearch ELK Stack Docker Kubernetes AWS Java Nakadi Scala Python Grafana Data Pipelines

Data Engineer

Productsup

Nov 2021 - Mar 2024 (2 years 4 months)

Designed and set up the entire data infrastructure for the Data Science team, including an on-premise Data Lake (Ceph) and other storage solutions. Created ETL and continuous data pipelines using Dagster and Python, and established an on-premise Spark cluster for data processing.

Data Engineering Ceph MariaDB SQLite AWS S3 ETL Dagster Rundeck Python Spark Grafana Docker gRPC Machine Learning

Backend Engineer

Searchmetrics

Mar 2018 - Nov 2021 (3 years 8 months)

Managed the largest European Elasticsearch cluster and supported enterprise SEO suite development by writing new services and features. Handled data processing, migration, and repairing tasks, and maintained several backend services while performing OPS tasks for the team.

Elasticsearch PHP Ansible Java Python Kafka AWS EC2 MySQL AWS Lambda Travis AWS ECS Backend Development

Education

Degrees, certifications, and relevant coursework

Faculty of Organization and Informatics

Masters Degree, Informatics

Activities and societies: Developed an Intelligent Multi-Agent System for Cryptocurrency Market Analysis; Researched and established a new methodology for vulnerability scanning tools evaluation; Created a computer game using Unity.

Completed a Master's Degree focusing on informatics and data analysis. Developed a self-sustaining multi-agent system for cryptocurrency market analysis as part of the Master's Thesis. Conducted research on vulnerability scanning tools evaluation methodologies.