# prashant thakur

prashant thakur is a remote worker on Himalayas, Data Engineer at HCL, based in India.

Source: https://himalayas.app/@prashantthakur2

```text
Data Engineer at HCL and IBM who built Azure Databricks pipelines sustaining 99% uptime.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 140k+ INR |
| Job categories | Data Engineer |
| Skills | Data Engineering, ETL, Data Pipeline Development, Data Ingestion, Azure Databricks, PySpark, Python, Spark SQL, Apache Spark, Delta Lake, Azure Data Factory, Azure Blob Storage, Azure Data Lake Storage, Azure Synapse, Kafka |
| LinkedIn | https://in.linkedin.com/in/prashant-t-thakur |
| GitHub | https://github.com/prth86 |
| Twitter | https://x.com/prashant9thakur |

## About

```text
At HCL, I designed and maintained Azure Databricks data pipelines that sustained 99% uptime for daily production processing. I also built ingestion workflows on Azure Blob Storage and ADF, cutting ingestion latency by 60%.

At IBM, I built Azure ingestion workflows and PySpark structured streaming modules to make data available for analytics. I also helped move legacy data from the local Hive Metastore into a centralized governance framework using Databricks Unity Catalog.

Across my data engineering work, I integrated MongoDB into ingestion pipelines and built CI/CD pipelines with Jenkins and Terraform. I also created Power BI and SSRS reports with custom DAX measures to give stakeholders faster access to KPIs.
```

## Experience

### Data Engineer

HCL. Feb 2025 - May 2026

```text
Designed and maintained end-to-end data pipelines on Azure Databricks using PySpark, Spark SQL, and Delta Lake, sustaining 99% uptime for daily production data processing. Built data ingestion workflows on Azure Blob Storage and ADF, cutting ingestion latency by 60%.
```

Skills: PySpark, Spark-SQL, Delta-Lake, Azure-Databricks, Azure-Data-Factory, Azure-Blob-Storage, ADLS, Synapse, Power-BI, Kafka, Azure-Event-Hub, Unity-Catalog, Collibra, MongoDB, Data-Modeling, Dimensional-Modeling

### Data Engineer

[IBM](https://himalayas.app/companies/ibm-com). Jun 2019 - Sep 2024

```text
Integrated Azure ADLS with Databricks notebooks and Genie Spaces to unify compute and reduce pipeline development effort. Built Azure data ingestion workflows using PySpark, reducing ingestion latency and improving pipeline throughput.
```

Skills: Azure-ADLS-Gen2, Databricks, Genie-Spaces, PySpark, Spark-Structured-Streaming, Unity-Catalog, MongoDB, Jenkins, CI-CD, Terraform, Kubernetes, Power-BI, SSRS, DAX

### IAM Engineer

Mecon. Nov 2012 - Mar 2018

```text
Configured Azure AD Connect for seamless on-premise AD sync with Office 365 and delivered L2/L3 support for identity, authentication, and access management. Administered Active Directory, SSO, ADFS, and Office 365 Enterprise users.
```

Skills: Azure-AD-Connect, Active-Directory, SSO, ADFS, Office-365, Microsoft-Office, Identity-Management

## Education

### BPUT

B.Tech, Information Technology

```text
Completed B.Tech in Information Technology, building a strong foundation in IT principles.
```

### Edureka

PowerBI, Business Intelligence

```text
Completed a PowerBI certification course, gaining skills in business intelligence and data visualization.
```

### IBM

IBM Agile Badge, Agile

```text
Awarded the IBM Agile Badge, recognizing proficiency in agile methodologies.
```

### IBM

IBM Hall of Fame, Recognition

```text
Received the IBM Hall of Fame award, acknowledging outstanding contributions.
```

### AXELOS

ITILv4 Certified, IT Service Management

```text
Certified in ITIL v4, demonstrating knowledge of IT service management best practices.
```

### BITS Pilani

M.Tech, Computers

```text
Pursued M.Tech in Computers, focusing on advanced computing concepts.
```

### Microsoft

AZ-900 Azure, Cloud Computing

```text
Earned the AZ-900 Azure Fundamentals certification, validating foundational cloud knowledge.
```

### Microsoft

AZ-400 DevOps, DevOps

```text
Earned the AZ-400 DevOps certification, demonstrating expertise in DevOps processes.
```

## Tech stack

- Azure Synapse
- Apache Spark
- Kubernetes
- Jenkins
- PySpark
- MySQL
- MongoDB
- Terraform
- Python
- Kafka
- Azure Active Directory
- Docker
- Azure Blob Storage
- Delta Lake
- Power BI
- Apache Kafka

To contact prashant, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [uma mahesh](https://himalayas.app/@umamahesh): Azure Data Engineer, Arete IR
- [Mahesh Desu](https://himalayas.app/@maheshdesu): Azure Data Engineer, Yallo Retail
- [Yash Varshney](https://himalayas.app/@yashvarshney2): Senior Data Engineer, Mars, Incorporated
- [Bhakti Padwal](https://himalayas.app/@bhaktipadwal): Senior Software Engineer, Tech Mahindra
- [adwait kharkar](https://himalayas.app/@adwaitkharkar): Azure Data Engineer, IFS India Mercantile Pvt. Ltd.
- [Sankara Narayanan Subramanian](https://himalayas.app/@sankaranarayanans): Lead Engineer, HCL Tech
- [Amitkumar Dixit](https://himalayas.app/@amitkumardixit): Senior Developer – Data Engineer, Wipro
- [ESWAR REDDY User](https://himalayas.app/@eswarreddyuser): Data Engineer, Capgemini
- [Tanmay Padhiar](https://himalayas.app/@tanmaypadhiar): Data Engineer, Fusion Practices
- [Pravin Singh](https://himalayas.app/@pbxr): Senior Data Engineer, Apexon