Open to opportunities

Jigar Vavadia

@jigarvavadia

Message

Data Engineer with expertise in big data technologies and analytics.

Canada

Message

What I'm looking for

I am looking for a challenging role that fosters growth, innovation, and collaboration in data engineering.

I am a dedicated Data Engineer with extensive experience in big data technologies, including Hadoop, Spark, and AWS. My journey has been marked by a commitment to delivering scalable and efficient data solutions. I thrive in dynamic environments, where I can leverage my skills in data mining, statistical analysis, and machine learning to drive impactful results.

Throughout my career, I have successfully led the development and deployment of custom Hadoop applications, optimized data ingestion pipelines, and implemented complex ETL workflows using Apache Airflow. My proficiency in programming languages such as Python, Scala, and Java, combined with my strong analytical skills, allows me to tackle challenging data problems and provide strategic recommendations that enhance business outcomes.

I am passionate about continuous learning and improvement, always seeking opportunities to expand my knowledge in emerging technologies and methodologies. I believe in the power of collaboration and effective communication, which has enabled me to work seamlessly with cross-functional teams to achieve common goals.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Violet Leaf

Dec 2024 - Present (8 months)

Built scalable, distributed data solutions using Hadoop, leading end-to-end development and deployment of custom Hadoop applications in AWS environments. Optimized Hadoop Hive performance with advanced techniques including partitioning, bucketing, and efficient join strategies on Hive tables.

Hadoop AWS Hive Apache Airflow Scala Python Git

Data Engineer

RBC

Jul 2023 - Dec 2024 (1 year 5 months)

Configured Kubernetes deployments, stateful sets, network policies, and a Kubernetes dashboard. Developed and deployed custom Hadoop applications in an AWS environment, processing large datasets using Apache Spark with Scala and Python.

Spark UDFS Kubernetes Hadoop AWS Apache Spark Scala Python Spark UDFs Apache Airflow

Data Engineer

Uptake

Sep 2021 - Apr 2023 (1 year 7 months)

Built scalable distributed data solutions using Hadoop and optimized Hadoop Hive performance through various techniques. Utilized Spark Streaming to collect data from AWS S3 bucket in near-real-time, performing necessary transformations and aggregations.

Spark UDFs Hadoop Hive AWS S3 Spring Boot Postgres Airflow Apache Spark Scala Python Spark UDFS Kubernetes Git

Programmer and Analyst

Classic Cone Studios

Apr 2020 - Aug 2020 (4 months)

Developed AI for game enemies and core features using C#, finite state machines, and behavior trees. Analyzed game data with SQL to enhance player experience and optimize game features.

C#Finite State Machines Behavior Trees SQL Agile Methodology Debugging

Analyst

Digiwagon

Jul 2016 - Sep 2019 (3 years 2 months)

Conducted web scraping using Beautiful Soup to collect data from various websites and used Python to transform and clean the data. Analyzed and interpreted various data sets using Microsoft Excel and Access to provide insights for product improvement and launch.

Python Microsoft Excel Visio HTML Data Analysis Cost Benefit Analysis

Education

Degrees, certifications, and relevant coursework

Sheridan College

Postgraduate Certificate, Computer Animation

Developed and created multiple 3D models using MEL scripting. Created animation using graphs and keyframes. Developed the background level with MEL & Python scripting in Maya for a Capstone Project.

Sheridan College

Postgraduate Certificate, Game Level Design

Created the entire game level from foundation, carefully analyzing user play to add challenges accordingly. Designed and developed a multiplayer game across different platforms in a group of two people. Designed, developed, tested, and deployed a fully functional game as part of a capstone group project.