Open to opportunities

Vaibhav Dahiwal

@vaibhavdahiwal

Message

Data Engineer with expertise in Big Data technologies and AWS.

India

Message

What I'm looking for

I am seeking a challenging role that fosters growth and innovation in data engineering.

I am a Data Engineer with over 2.8 years of experience in Big Data technologies, including PySpark, Python, HBase, and Hive. My journey in IT has been marked by a commitment to leveraging data for actionable insights, and I thrive on challenges that allow me to explore my full potential.

Currently, I work at Randstad Technologies, where I developed a cloud-based data pipeline for sales analytics using AWS and Spark. This project involved automating data ingestion, schema validation, and enrichment for business reporting, ensuring reliability through error handling and logging. My technical skills encompass a wide range of tools and technologies, enabling me to contribute effectively to data-driven decision-making.

Experience

Work history, roles, and key accomplishments

Current

Process Executive (ETL)

Current

Randstad Technologies

Feb 2022 - Present (3 years 4 months)

Developed an end-to-end data pipeline to process, validate, and transform transactional sales data using AWS S3, PySpark, and MySQL. Automated data ingestion, schema validation, and enrichment for business reporting, ensuring reliability with error handling and logging.

Pyspark AWS S3 MySQL Python GitHub ETL Data Pipelines Shell Scripting Window Functions

Education

Degrees, certifications, and relevant coursework

MSS College Of Engineering And Technology

Bachelor of Engineering, Mechanical Engineering

2017 - 2021

Grade: 78.7%

Completed a Bachelor of Engineering in Mechanical Engineering, focusing on various engineering principles and practices. Achieved a strong academic performance with a percentage of 78.7%.

Government Polytechnic College

Diploma in Mechanical Engineering, Mechanical Engineering

2016 - 2018

Grade: 58.88%

Pursued a Diploma in Mechanical Engineering, gaining foundational knowledge in mechanical systems and engineering practices. Graduated with a percentage of 58.88%.