# Debjit Nandan

Debjit Nandan is a remote worker on Himalayas, Associate Data Engineer at Celebal Technologies, based in India.

Source: https://himalayas.app/@debjitnandan

```text
Associate Data Engineer at Celebal Technologies who deployed production ETL pipelines processing 10M+ daily records.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 1002k+ INR |
| Job categories | Data Engineer |
| Skills | ETL Pipelines, Data Engineering, Data Pipeline Development, Data Validation, Data Reconciliation, Data Migration, Incremental Loading, SCD2, Data Governance, Data Lineage, System Integration Testing, Python, SQL, PySpark, Apache Spark |

## About

```text
At Celebal Technologies, I architected and deployed production ETL pipelines on Azure Databricks and Delta Lake, processing 10M+ daily records and improving analytics data availability by 20%.

I integrated Azure Data Factory, Azure Data Lake, and Azure SQL Database to create dynamic, event-driven pipelines, eliminating 8+ hours per week of manual data movement. I also developed data validation and reconciliation frameworks that reduced pipeline error rates by 30%.

On my Metadata-Driven ELT Pipeline project, I created a framework using Azure Data Factory and PySpark to migrate 25+ Oracle data sources to Databricks Enterprise Data Lake. Its metadata control table enabled fully parameterized pipeline execution, while incremental loading reduced data transfer volumes by 60%.

I also implemented SCD Type 2 logic with ADF Mapping Data Flows and Delta Lake, and added reconciliation checks, integration testing, and audit logging. My work includes a publication on predictive maintenance and real-time monitoring of electric vehicles, published in IEEE TENCON 2024.
```

## Experience

### Associate Data Engineer (current)

Celebal Technologies. Sep 2024 - Present

```text
Architected and deployed production-grade ETL pipelines on Azure Databricks and Delta Lake, processing over 10 million daily records and improving analytics data availability by 20%. Integrated Azure Data Factory, Data Lake, and SQL Database to build dynamic, event-driven pipelines, and designed automated validation frameworks reducing error rates by 30%.
```

Skills: Python, SQL, PySpark, Apache-Spark, Azure-Databricks, Azure, Azure-Data-Factory, Azure-Data-Lake, Azure-SQL-Database, Microsoft-SQL-Server, Oracle-DB, VSCode, GitHub, Claude-Code

## Education

### Claude

Claude Certified Architect, Architecture

```text
Certified as a Claude Certified Architect in June 2026.
```

### Databricks

Databricks Certified Data Engineer Professional, Data Engineering

```text
Certified as a Databricks Certified Data Engineer Professional in March 2025.
```

### Databricks

Databricks Certified Data Engineer Associate, Data Engineering

```text
Certified as a Databricks Certified Data Engineer Associate in February 2025.
```

### Jalpaiguri Government Engineering College

Bachelor of Technology, Electronics and Communication Engineering. 2020 - 2024. Grade: 8.57

```text
Bachelor of Technology in Electronics and Communication Engineering from Jalpaiguri Government Engineering College, with a DGPA of 8.57.
```

## Tech stack

- Apache Spark
- Microsoft Azure
- GitHub
- PySpark
- Microsoft SQL Server
- Python
- Azure SQL Database
- SQL
- Delta Lake
- Claude Code

To contact Debjit, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Hemant Bawane](https://himalayas.app/@hemantbawane1): Associate Data Engineer, Celebal Technologies
- [Venkata Krishna Reddy Kolli](https://himalayas.app/@venkatakrishnareddyk): Associate Data Engineer, Centillion Networks Pvt Ltd
- [Riyanka Pal](https://himalayas.app/@riyankapal): Data Engineer, ZS Associates
- [Abhimanyu Gabhrani](https://himalayas.app/@abhimanyugabhrani): Data Engineer, Celebal Technologies
- [Satyansh User](https://himalayas.app/@satyanshuser): Data Engineer, Memorae.ai
- [Lekhana Donthula](https://himalayas.app/@lekhanadonthula): Data Engineering Intern, Celebal Technologies
- [Dipesh Chaudhary](https://himalayas.app/@dipeshchaudhary1): Data Engineer, Celebal Technologies Pvt. Ltd.
- [Tushar sontakke](https://himalayas.app/@tusharsontakke): Data Engineering Intern, Celebal Technologies
- [Santoshi Haritha Kompella](https://himalayas.app/@santoshiharithakompe): Data Engineer, Tech Mahindra
- [Mohammed Sameer](https://himalayas.app/@mohammedsameer2): Data Engineer Intern, Celebal Technologies
