Open to opportunities

Kunal Vaghela

@kunalvaghela

Message

Senior Data Engineer with expertise in scalable data infrastructure.

Canada

Message

What I'm looking for

I am seeking a role that fosters innovation, collaboration, and continuous learning in data engineering.

I am a Senior Data Engineer with over 8 years of experience in building and optimizing scalable data infrastructure. My journey has been marked by a strong focus on delivering Databricks data platforms and Spark-based data pipelines. I possess advanced proficiency in Databricks, PySpark, Java, SQL, C#, and TypeScript, which I leverage to solve complex data engineering problems in fast-paced environments.

Throughout my career, I have demonstrated strong leadership skills by mentoring teams and fostering collaboration in cross-functional, agile startup settings. My technical expertise spans Azure, ETL/ELT processes, pipeline migration, and workflow automation. I am committed to ensuring data quality, performance, and reliability while driving technical innovation and efficiency.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

SCALE-AI

Jan 2023 - Present (2 years 8 months)

Architected and maintained scalable ETL/ELT pipelines in Databricks using PySpark, Java, C#, and SQL to ingest and process high-volume data from Azure Blob Storage, ADLS, and relational/non-relational sources. Led migration of pipelines to Databricks Lakehouse, supporting both relational and non-relational (NoSQL) databases to drive flexibility and scalability for data products.

Databricks Pyspark Java C#SQL Azure Blob Storage ADLS ETL CI CD Azure DevOps

Data Engineer / Analyst

Matrix Comsec Pvt Ltd

Jan 2016 - Present (9 years 8 months)

Designed, deployed, and optimized ETL pipelines in Databricks and Spark, integrating diverse data sources including SQL Server, Oracle, APIs, and NoSQL/non-relational databases. Developed data integration solutions in Python, C#, and TypeScript for workflow automation and business intelligence reporting.

Databricks Spark ETL SQL Server Oracle Python C#TypeScript NoSQL Data Integration

Education

Degrees, certifications, and relevant coursework

St. Clair College

Postgraduate Certificate, Data Analytics for Business

2023 - 2024

Completed a postgraduate certificate program focused on data analytics for business. Gained expertise in leveraging data to drive business decisions and solve complex problems.

Vishwakarma Engineering College

Bachelor, Computer Science (Information Technology)

2011 - 2015

Earned a Bachelor's degree in Computer Science with a specialization in Information Technology. Developed a strong foundation in computer science principles, programming, and information systems.