Open to opportunities

Gigi Jani

@gigijani

Message

Senior Data / AI Engineer specializing in scalable data solutions.

Germany

Message

What I'm looking for

I am looking for a role that fosters innovation and collaboration, where I can leverage my skills in data engineering and AI to drive impactful solutions.

I am a Senior Data / AI Engineer with extensive experience in ETL, ELT, and data lake architecture. My expertise lies in building scalable ingestion processes and optimizing data pipelines, ensuring high data quality and schema consistency. I have a strong background in LLM models, Knowledge Graphs, and NLP, utilizing tools such as Python, Spark, and SQL to drive data-driven solutions.

At Idealo, I have successfully developed real-time data ingestion pipelines and managed Trino on Kubernetes, enabling teams to run queries efficiently. My role also involves designing AI-powered solutions that enhance data integrity and compliance with GDPR regulations. I am passionate about performance tuning and cost optimization, leveraging technologies like AWS and Azure to deliver impactful results.

Throughout my career, I have worked collaboratively with diverse teams to tackle complex business challenges. My commitment to continuous learning and innovation drives me to stay updated with the latest technologies and methodologies in the data engineering field.

Experience

Work history, roles, and key accomplishments

Current

Senior Data/AI Engineer

Current

Idealo

Dec 2023 - Present (1 year 5 months)

Developed real-time data ingestion pipelines using Kafka, Iceberg, and Python, ensuring high data quality and security with AWS Lake Formation. Designed and implemented AI-powered solutions leveraging LLMs and Knowledge Graphs to analyze data and detect incorrect listings, enhancing platform integrity.

Kafka Iceberg Python AWS Lake Formation Kubernetes GitOps Docker LLM Knowledge Graphs Terraform Grafana Prometheus

Data Engineer

OLX Group

Oct 2021 - Dec 2023 (2 years 2 months)

Built services to handle near real-time transactional data using Spark, Scala, Delta Lake, and AWS, designing scalable infrastructure for large-scale data collection and processing. Developed and maintained a service providing operational data snapshots using AWS SQS, Lambda, S3, and the data lake, alongside an event-driven application for managed tables and metadata via AWS Athena.

Spark Scala Delta Lake AWS SQS Lambda S3 Kinesis Docker Kubernetes Python GitHub Prometheus Grafana Kibana

Business Intelligence / Data Engineer

Scout24

Jun 2018 - Sep 2021 (3 years 3 months)

Designed and built scalable infrastructure and platforms for collecting and processing large amounts of structured and unstructured data, including real-time streaming data, while maintaining the Data Lake. Deployed and maintained data tools infrastructure like Presto, MicroStrategy, and Alation on AWS Cloud, providing training and support to users and enabling data scientists and analysts to buil

Python Spark SQL AWS GitHub Linux Data Warehouse Data Lake Presto Microstrategy Alation Jira Prometheus Grafana

Data warehouse developer

Tata Consultancy Services

Jun 2016 - Jun 2017 (1 year)

Maintained traditional Data Warehouse systems for the Fiat Chrysler Automotive industry, translating business needs into engineering systems by creating BRD documents. Extracted and transformed data from OLTP systems using DataStage, loading data into Data Marts and the Data Warehouse, and developed and maintained cubes and dashboards on MicroStrategy for business insights.

DataStage SQL Microstrategy RDBMS NoSQL ETL

DataStage Developer

Hexaware Technologies

Sep 2012 - Apr 2016 (3 years 7 months)

Developed an ETL module for Northern Trust to facilitate business analysts in reviewing investment decisions, processing business decisions both in batch and real-time. Created parallel jobs and sequencers, wrote UNIX scripts for job execution, and managed mainframe data transfer to Linux boxes using FTP scripts for loading into DB2 tables.

Unix FTP ETL Java Shell Scripting

Education

Degrees, certifications, and relevant coursework

TU Berlin

Masters in Computer Science, Computer Science

Pursued advanced studies in Computer Science at TU Berlin, focusing on specialized topics within the field. Gained in-depth knowledge and practical experience in cutting-edge technologies and methodologies.

Rajiv Gandhi Technical University

Bachelors in Computer Science, Computer Science

Completed a Bachelor's degree in Computer Science at Rajiv Gandhi Technical University. Acquired foundational knowledge and skills in various aspects of computer science, preparing for a career in technology.