# Kunal Vaghela

Kunal Vaghela is a remote worker on Himalayas, Senior Data Engineer at SCALE-AI, based in Canada.

Source: https://himalayas.app/@kunalvaghela

```text
Senior Data Engineer with expertise in scalable data infrastructure.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | Canada |
| Authorized to work in | Canada |
| Job categories | Senior Data Engineer, Data Engineer, Data Analyst, Data Architect, Cloud Engineer, Senior Data Management Engineer, Senior Data Engineering Leader, Senior ETL Engineer, Data Platform Engineer |
| Skills | Python, Java, C#, TypeScript, PySpark, SQL, Databricks, ETL ELT Data Pipelines, Data Ingestion, Data Modeling, Data Migration, Azure, NoSQL, REST APIs, Airflow, Data Quality, Kubernetes, Clair, Jenkins, Pandas, MongoDB, Azure DevOps, Jira, MLFlow, SQLAlchemy, Azure Blob Storage, Elasticsearch |

## What I'm looking for

```text
I am seeking a role that fosters innovation, collaboration, and continuous learning in data engineering.
```

## About

```text
I am a Senior Data Engineer with over 8 years of experience in building and optimizing scalable data infrastructure. My journey has been marked by a strong focus on delivering Databricks data platforms and Spark-based data pipelines. I possess advanced proficiency in Databricks, PySpark, Java, SQL, C#, and TypeScript, which I leverage to solve complex data engineering problems in fast-paced environments.

Throughout my career, I have demonstrated strong leadership skills by mentoring teams and fostering collaboration in cross-functional, agile startup settings. My technical expertise spans Azure, ETL/ELT processes, pipeline migration, and workflow automation. I am committed to ensuring data quality, performance, and reliability while driving technical innovation and efficiency.
```

## Experience

### Senior Data Engineer (current)

[SCALE-AI](https://himalayas.app/companies/scale). Jan 2023 - Present

```text
Architected and maintained scalable ETL/ELT pipelines in Databricks using PySpark, Java, C#, and SQL to ingest and process high-volume data from Azure Blob Storage, ADLS, and relational/non-relational sources. Led migration of pipelines to Databricks Lakehouse, supporting both relational and non-relational (NoSQL) databases to drive flexibility and scalability for data products.
```

Skills: Databricks, PySpark, Java, C#, SQL, Azure-Blob-Storage, ADLS, ETL, CI-CD, Azure-DevOps

### Data Engineer / Analyst

Matrix Comsec Pvt Ltd. Jan 2016 - Present

```text
Designed, deployed, and optimized ETL pipelines in Databricks and Spark, integrating diverse data sources including SQL Server, Oracle, APIs, and NoSQL/non-relational databases. Developed data integration solutions in Python, C#, and TypeScript for workflow automation and business intelligence reporting.
```

Skills: Databricks, Spark, ETL, SQL-Server, Oracle, Python, C#, TypeScript, NoSQL, Data-Integration

## Education

### St. Clair College

Postgraduate Certificate, Data Analytics for Business. 2023 - 2024

```text
Completed a postgraduate certificate program focused on data analytics for business. Gained expertise in leveraging data to drive business decisions and solve complex problems.
```

### Vishwakarma Engineering College

Bachelor, Computer Science (Information Technology). 2011 - 2015

```text
Earned a Bachelor's degree in Computer Science with a specialization in Information Technology. Developed a strong foundation in computer science principles, programming, and information systems.
```

## Tech stack

- Kubernetes
- Clair
- Jenkins
- Pandas
- PySpark
- DB
- MongoDB
- Gmail
- Databricks
- Azure DevOps
- Jira
- Java
- MLflow
- SQLAlchemy
- Elasticsearch
- Airflow
- Root Cause
- SQL
- Azure Blob Storage

To contact Kunal, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Aditya Dev](https://himalayas.app/@adityadev): Sr. Azure Data Engineer, ICBC
- [Tvisha Patel](https://himalayas.app/@tvishapatel): Senior Data Engineer Azure, Walmart
- [yaswanth sai kalastri](https://himalayas.app/@yaswanthsaikalastri): Data Engineer, Aviva
- [Bala Sathwik Golamari](https://himalayas.app/@balasathwikgolamari): Data Engineer, Pollard Banknote
- [Saikrishna Pamu](https://himalayas.app/@saikrishnapamu): Senior Azure Data Engineer, CGI / TD Bank
- [Kalyan Kumar](https://himalayas.app/@kalyankumar1): Azure Data Engineer, Ford
- [Venkat Samir](https://himalayas.app/@venkatsamir): Sr. Data Engineer, Amaris Consulting
- [Vijitha Kanumuru](https://himalayas.app/@vijithakanumuru): Senior Data Engineer, Sgi
- [Keval Dainik](https://himalayas.app/@kevaldainik): Senior Data Engineer, Deloitte
- [Chaudhari Keval](https://himalayas.app/@chaudharikeval): Senior Data Engineer, EY
