# sangram dudhagaonkar

sangram dudhagaonkar is a remote worker on Himalayas, Azure Data Engineer at Tata Consultancy Services, based in India.

Source: https://himalayas.app/@sangramdudhagaonkar

```text
Azure Data Engineer at Tata Consultancy Services building banking ETL pipelines with Azure Data Factory, Databricks, and Delta Lake.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 140k+ INR |
| Job categories | Azure Data Engineer, Data Engineer |
| Skills | Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Data Lake Storage Gen2, Delta Lake, PySpark, Apache Spark, SQL, Azure SQL Database, SQL Server, ETL, Data Pipeline Development, Medallion Architecture, Incremental Loading, Spark Optimization |
| LinkedIn | https://linkedin.com/in/sangram-dudhagaaonkar-dataengineer |

## About

```text
At Tata Consultancy Services, I developed end-to-end ETL pipelines for a banking data migration, moving data from on-premise SQL Server into Azure Data Lake Storage Gen2. I implemented Bronze, Silver, and Gold layers with Azure Databricks and Delta Lake.

I built PySpark notebooks for cleansing, transformation, validation, and aggregation, and configured Databricks Jobs to run through Azure Data Factory pipelines. I also implemented incremental loading and Spark optimization techniques.

Earlier, at Narayani Engineering & Software Technologies, I assisted with Azure Data Factory pipelines, PySpark transformations, and Delta Lake tables. I supported pipeline monitoring, testing, deployment, and production activities.
```

## Experience

### Azure Data Engineer (current)

[Tata Consultancy Services](https://himalayas.app/companies/tata-consultancy-services). Jun 2024 - Present

```text
Developed end-to-end ETL pipelines using Azure Data Factory for data ingestion and processing. Implemented Medallion Architecture with Azure Databricks and Delta Lake, and optimized Spark jobs for performance.
```

Skills: Azure-Data-Factory, Azure-Databricks, Data-Lake-Storage-Gen2, Delta-Lake, PySpark, SQL, Spark-Optimization, Watermark, Azure-SQL-Database, Monitoring, Alerting

### Data Engineer

O2F Info Solution. Aug 2022 - Jun 2024

```text
Migrated data from on-premise client databases to Azure Data Lake using Azure Data Factory, then processed with PySpark in Databricks. Orchestrated pipelines and transferred data to Azure SQL Database for analysis.
```

Skills: Azure-Data-Factory, Azure-Data-Lake, Azure-Databricks, PySpark, Azure-SQL-Database, Azure-Functions, Data-Migration

### Associate Data Engineer

Narayani Engineering & Software Technologies. Dec 2022 - Sep 2023

```text
Assisted in developing ETL pipelines using Azure Data Factory and extracted banking data from SQL Server into ADLS Gen2. Created Delta Lake tables and monitored pipeline execution.
```

Skills: Azure-Data-Factory, Data-Lake-Storage-Gen2, PySpark, Delta-Lake, SQL-Server, Pipeline-Monitoring

## Education

### Shivaji University Kolhapur

Bachelor of Engineering, Engineering

```text
Bachelor of Engineering degree from Shivaji University Kolhapur, completed in 2020.
```

## Tech stack

- Apache Spark
- GitHub
- PySpark
- PostgreSQL
- Yarn
- PyCharm
- Jira
- Azure SQL Database
- SQL
- Delta Lake
- Unity Catalog

To contact sangram, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Abhilash Amilineni](https://himalayas.app/@abhilashamilineni): Data Engineer, Asics Technologies
- [Sarang Deshmukh](https://himalayas.app/@sarangdeshmukh): Data Engineer, Tech Mahindra
- [sushant yadav](https://himalayas.app/@sushantyadav): Azure Data Engineer, Tata Consultancy Services
- [Vijay Reddy](https://himalayas.app/@vijayreddy4): Data Engineer, Tata Consultancy Services
- [Kanak Dhakaria](https://himalayas.app/@kanakdhakaria): System Engineer (Azure Data Engineer Developer), Tata Consultancy Services
- [Sameer Kumar](https://himalayas.app/@sameerkumar10): Software Engineer II, MAQ Software
- [vaibhav Agrahari](https://himalayas.app/@vaibhavagrahari): Senior Data Engineer, LTIMindtree
- [Saurabh Tiwari](https://himalayas.app/@saurabhtiwari6): Data Engineer, Tata Consultancy Services
- [Atharv Pawar](https://himalayas.app/@atharvpawar3): Data Engineer, Tata Consultancy Services
- [Sushma Madhavi Koviri](https://himalayas.app/@sushmamadhavi): Azure Data Engineer, Tata Consultancy Services