# Kushal Shah

Kushal Shah is a remote worker on Himalayas, Data Engineer at LTIMindtree, based in Canada.

Source: https://himalayas.app/@kushalshah2

```text
I build Azure data pipelines and governed analytics datasets at cloud scale.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | Canada |
| Authorized to work in | Canada |
| Job categories | Data Engineer, Data Analyst, Business Analyst, Analytics Engineer, Business Intelligence Developer, Data Scientist, Data Engineer Jobs, Data Engineering, Data Engineering Specialist, Data Engineering Jobs, Data Engineering Positions |
| Skills | Python, SQL, PySpark, Apache Spark, Pandas, Window Functions, Query Optimization, Statistical Analysis, Hypothesis Testing, A B Testing, regression, Time Series Modeling, Feature Engineering, Anomaly Detection, Business Requirements Documentation, Functional Specifications, User Stories, Process Mapping, Gap Analysis, Source To Target Mapping, Agile, Scrum, Jira, Star Schemas, Dimensional Models, Medallion Architecture, DBT, Cloud Data Warehousing, Azure Databricks, Delta Lake, Delta Live Tables, Unity Catalog, Azure Data Factory, Azure ADLS Gen2, Microsoft Fabric, OneLake, ETL, ELT, Airflow, Databricks Workflows, Spark Structured Streaming, Event Hub, Power BI, DAX, Tabular Editor, Calculation Groups, Semantic Modelling, Tableau, KPI Design, Dashboard Design, PostgreSQL, SQL Server, MySQL, Git, GitHub, Azure DevOps, CI CD, Databricks Asset Bundles, Data Reliability Frameworks, RBAC, ACID, Data Lineage, Metadata Management, azure monitor, Stakeholder Management, Cross Functional Collaboration, Executive Reporting, Technical Documentation, Data Storytelling, MLFlow, Databricks, Factory |

## What I'm looking for

```text
I'm looking to build governed, cloud-scale data platforms and analytics products where I can partner with business stakeholders, improve data quality and performance, and deliver trusted self-service reporting.
```

## About

```text
At LTIMindtree, I build Azure Databricks and Airflow ELT pipelines that process 1.8TB daily across APIs, cloud storage, and databases. My work cut batch runtime by 42%, reduced compute cost by 31%, and raised reliability to 99.8%.

I translate finance, sales, and operations requirements into source-to-target mappings, dimensional data marts, and governed self-service Power BI reporting. I’ve also implemented Unity Catalog governance, role-based access controls, lineage, metadata management, and CI/CD releases through Azure DevOps and Databricks Asset Bundles.

Previously at Mphasis, I built centralized analytics pipelines, modernized Databricks workflows, and optimized SQL to reduce report generation time by 52%. I also use statistical anomaly detection and monitoring to improve data quality and reduce production issues.
```

## Experience

### Data Engineer (current)

[LTIMindtree](https://himalayas.app/companies/ltimindtree). Sep 2024 - Present

```text
Built ELT pipelines in Python, PySpark, Azure Databricks, Delta Lake, and Airflow processing 1.8TB daily, cutting batch runtime 42%, lowering compute cost 31%, and raising reliability to 99.8%. Authored business requirements documents and source-to-target mappings for 20+ pipelines, and engineered statistical anomaly detection reducing production data issues by 48%.
```

Skills: Python, PySpark, Azure-Databricks, Delta-Lake, Airflow, SQL, Power-BI, Unity-Catalog, Azure-DevOps, Databricks-Asset-Bundles, MLFlow, Statistical-Analysis, Anomaly-Detection, CI-CD

## Education

### Sheridan College

Diploma, Computer Engineering

```text
Pursuing a Computer Engineering Technician diploma at Sheridan College in Ontario, Canada.
```

## Tech stack

- GitHub
- Pandas
- PySpark
- dbt
- MySQL
- PostgreSQL
- Databricks
- Jira
- MLflow
- Azure Monitor
- Airflow
- SQL
- Delta Lake
- Microsoft Fabric
- Unity Catalog
- Factory

To contact Kushal, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [vaishnavi User](https://himalayas.app/@vaishnaviuser3): Data Analyst Intern, Npower Canada
- [sachin varma kucharlapati](https://himalayas.app/@sachinvarmakucharlapati): Sr Data Engineer, Canadian Tire
- [Upendra Neil](https://himalayas.app/@upendraneil): Azure Data Engineer, Bell
- [Bala Sathwik Golamari](https://himalayas.app/@balasathwikgolamari): Data Engineer, Pollard Banknote
- [Saikrishna Pamu](https://himalayas.app/@saikrishnapamu): Senior Azure Data Engineer, CGI / TD Bank
- [Vijitha Kanumuru](https://himalayas.app/@vijithakanumuru): Senior Data Engineer, Sgi
- [Ismail Yunus](https://himalayas.app/@ismailyunus): Data Engineer / Cloud Data Consultant, Alphadot
- [Sai praneeth Boddupalli](https://himalayas.app/@saipraneethboddupall): Azure Data Engineer, Price Industries
- [Chaudhari Keval](https://himalayas.app/@chaudharikeval): Senior Data Engineer, EY
- [Peter Michael](https://himalayas.app/@petermichael2): Senior Data Engineer, EY
