Gigi Jani
@gigijani
Senior Data / AI Engineer specializing in scalable data solutions.
What I'm looking for
I am a Senior Data / AI Engineer with extensive experience in ETL, ELT, and data lake architecture. My expertise lies in building scalable ingestion processes and optimizing data pipelines, ensuring high data quality and schema consistency. I have a strong background in LLM models, Knowledge Graphs, and NLP, utilizing tools such as Python, Spark, and SQL to drive data-driven solutions.
At Idealo, I have successfully developed real-time data ingestion pipelines and managed Trino on Kubernetes, enabling teams to run queries efficiently. My role also involves designing AI-powered solutions that enhance data integrity and compliance with GDPR regulations. I am passionate about performance tuning and cost optimization, leveraging technologies like AWS and Azure to deliver impactful results.
Throughout my career, I have worked collaboratively with diverse teams to tackle complex business challenges. My commitment to continuous learning and innovation drives me to stay updated with the latest technologies and methodologies in the data engineering field.
Experience
Work history, roles, and key accomplishments
Senior Data/AI Engineer
Idealo
Dec 2023 - Present (1 year 6 months)
Developed real-time data ingestion pipelines using Kafka, Iceberg, and Python, ensuring high data quality and security with AWS Lake Formation. Designed and implemented AI-powered solutions leveraging LLMs and Knowledge Graphs to analyze data and detect incorrect listings, enhancing platform integrity.
Data Engineer
OLX Group
Oct 2021 - Dec 2023 (2 years 2 months)
Built services to handle near real-time transactional data using Spark, Scala, Delta Lake, and AWS, designing scalable infrastructure for large-scale data collection and processing. Developed and maintained a service providing operational data snapshots using AWS SQS, Lambda, S3, and the data lake, alongside an event-driven application for managed tables and metadata via AWS Athena.
Business Intelligence / Data Engineer
Scout24
Jun 2018 - Sep 2021 (3 years 3 months)
Designed and built scalable infrastructure and platforms for collecting and processing large amounts of structured and unstructured data, including real-time streaming data, while maintaining the Data Lake. Deployed and maintained data tools infrastructure like Presto, MicroStrategy, and Alation on AWS Cloud, providing training and support to users and enabling data scientists and analysts to buil
Data warehouse developer
Tata Consultancy Services
Jun 2016 - Jun 2017 (1 year)
Maintained traditional Data Warehouse systems for the Fiat Chrysler Automotive industry, translating business needs into engineering systems by creating BRD documents. Extracted and transformed data from OLTP systems using DataStage, loading data into Data Marts and the Data Warehouse, and developed and maintained cubes and dashboards on MicroStrategy for business insights.
DataStage Developer
Hexaware Technologies
Sep 2012 - Apr 2016 (3 years 7 months)
Developed an ETL module for Northern Trust to facilitate business analysts in reviewing investment decisions, processing business decisions both in batch and real-time. Created parallel jobs and sequencers, wrote UNIX scripts for job execution, and managed mainframe data transfer to Linux boxes using FTP scripts for loading into DB2 tables.
Education
Degrees, certifications, and relevant coursework
TU Berlin
Masters in Computer Science, Computer Science
Pursued advanced studies in Computer Science at TU Berlin, focusing on specialized topics within the field. Gained in-depth knowledge and practical experience in cutting-edge technologies and methodologies.
Rajiv Gandhi Technical University
Bachelors in Computer Science, Computer Science
Completed a Bachelor's degree in Computer Science at Rajiv Gandhi Technical University. Acquired foundational knowledge and skills in various aspects of computer science, preparing for a career in technology.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Interested in hiring Gigi?
You can contact Gigi and 90k+ other talented remote workers on Himalayas.
Message GigiFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
