# Deepali Deshmukh Dange

Deepali Deshmukh Dange is a remote worker on Himalayas, Data Engineer at IBM, based in United States.

Source: https://himalayas.app/@deepalideshmukhdange

```text
Data engineer at IBM on GEICO’s Policy Data Vertical, optimizing a Spark join to cut runtime by 35%.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 60k+ USD |
| Job categories | Data Engineer, Big Data Developer, QA Analyst |
| Skills | Data Engineering, ETL ELT, Data Pipelines, Data Quality, Data Validation, Data Reconciliation, Data Profiling, Apache Spark, PySpark, Spark SQL, Hive, Snowflake, DBT, DataVault 2.0 |
| LinkedIn | https://linkedin.com/in/deepdesh |
| GitHub | https://github.com/DeepaliDDange |

## About

```text
At IBM, I was a key contributor on GEICO’s Policy Data Vertical, developing and maintaining Spark and Hive transformations that processed 500 GB to several TB per day. I converted legacy Hive and SQL transformations into Spark SQL and DataFrame jobs on YARN.

I diagnosed a skewed Spark join using the Spark UI and re-engineered it as a broadcast join, cutting runtime from about 100 to 65 minutes. I checked accuracy with row-count and aggregate reconciliation.

I owned the transformation layer of a roughly 20-table migration to Snowflake, building dbt staging and business models and Data Vault 2.0 mappings. At Capgemini, I built HiveQL transformations over raw HDFS data and performed Oracle SQL backend validation for GE Healthcare’s cardiology product.

I also built a serverless AWS streaming and batch data platform, and a RAG data pipeline with a data-quality gate before Qdrant indexing. I recently completed an MS in Artificial Intelligence at The University of Texas at Austin and hold AWS and Azure data engineering certifications.
```

## Experience

### Data Engineer

[IBM](https://himalayas.app/companies/ibm-com). Jun 2020 - Apr 2023

```text
Developed and maintained large-scale Spark/Hive transformations processing 500 GB to several TB per day. Converted legacy Hive/SQL transformations to Spark SQL and DataFrame jobs, optimized a skewed join, and led a migration to Snowflake with dbt.
```

Skills: Apache-Spark, Hive, Spark-SQL, Yarn, Snowflake, DBT, DataVault-2.0, Data-Quality, Data-Validation, Mentorship

### Associate Consultant – Big Data Developer

[Capgemini](https://himalayas.app/companies/capgemini-technology-services). Apr 2019 - Apr 2020

```text
Built HiveQL transformations over raw HDFS data landed from Oracle via Sqoop, including external tables, filtering, type casting, and deduplication, writing date-partitioned ORC for efficient analytical queries.
```

Skills: Hive, HDFS, Sqoop, Oracle, ORC, Partitioning, data-transformation

### Quality Assurance Analyst – Data Validation

[Capgemini](https://himalayas.app/companies/capgemini-technology-services). Mar 2017 - Mar 2019

```text
Performed Oracle SQL backend validation for GE Healthcare's cardiology product, reconciling application data against database tables, views, and audit/history records. Verified trigger-driven data outcomes against functional requirements and reported defects.
```

Skills: Oracle-SQL, Data-Validation, Data-Reconciliation, Healthcare, Defect-Reporting

## Education

### The University of Texas at Austin

Master of Science, Artificial Intelligence. 2024 - Present. Grade: 3.97/4.0

```text
Pursuing a Master of Science in Artificial Intelligence with a GPA of 3.97/4.0, expected to graduate in May 2026.
```

### RGPV University

Bachelor of Engineering, Electronics & Communication. 2012 - 2016. Grade: 8.29/10

```text
Completed a Bachelor of Engineering in Electronics & Communication with a CGPA of 8.29/10.
```

## Tech stack

- Snowflake
- Apache Spark
- AWS Glue
- AWS IAM
- Amazon S3
- Pandas
- PySpark
- dbt
- MySQL
- Oracle
- Azure DevOps
- Python
- FastAPI
- Grafana
- Prometheus
- Amazon Kinesis
- AWS Lambda
- Git
- Amazon Athena
- SQL
- Qdrant
- AWS

To contact Deepali, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Chinnolla Sathvik Reddy User](https://himalayas.app/@chinnollasathvikredd): Data Engineer, Centene
- [Yash raj](https://himalayas.app/@yashraj6): Data Engineer, UnitedHealth Group
- [tejashwi shrestha](https://himalayas.app/@tejashwishrestha): Senior Data Engineer, MetLife
- [Saritha Reddy Kamasani](https://himalayas.app/@sarithareddykamasani): Data Engineer, Abbott
- [Tanmanpreet Singh](https://himalayas.app/@tanmanpreetsingh): Sr. Data Engineer, USAA
- [Adarsha Khadka](https://himalayas.app/@adarshakhadka): Senior Data Engineer, Allstate
- [Utsav Ghimire](https://himalayas.app/@utsavghimire): Senior Data Engineer, Cigna
- [Pratiksha KC](https://himalayas.app/@pratikshakc): Senior Data Engineer, Cigna
- [Rakshya Raut](https://himalayas.app/@rakshyaraut): Associate Data Scientist/Engineer, Elevance Health
- [Puneeth Ravilla](https://himalayas.app/@puneethravilla): Senior Data Engineer, CVS Health
