# MANISH KUMAR

MANISH KUMAR is a remote worker on Himalayas, Senior Data Engineer at Particle Black, based in India.

Source: https://himalayas.app/@manishkumar86

```text
Senior Data Engineer at Particle Black building real-time healthcare pipelines that process over 100 million records daily.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 4983k+ INR |
| Job categories | Data Engineer |
| Skills | Data Engineering, Real Time Data Pipelines, Data Warehouse, ETL, Big Data, Data Processing, Data Pipeline Optimization, Data Ingestion, GDPR Compliance, HIPAA compliance, Healthcare Data, Apache Spark, PySpark, Spark SQL, Apache Beam |

## About

```text
At Particle Black, I developed real-time healthcare data pipelines for Patient, Encounter, and Procedure data, processing records from ingestion through the outbound layer. The pipelines process over 100 million records daily, with end-to-end processing under five seconds and failure and duplication rates below 1%.

At Expedia, I built an automated data extraction framework for GDPR and HIPAA compliance that reduced manual processing from four hours to under ten minutes. Earlier, at Reliance Jio, I led and mentored four data engineers and engineered a cloud-based invoicing platform that improved invoicing accuracy by 100%.
```

## Experience

### Senior Data Engineer (current)

Particle Black. May 2026 - Present

```text
Developed end-to-end real-time healthcare data pipelines for Patient, Encounter and Procedure domains, processing clinical data from ingestion through the outbound layer and supporting automated reprocessing of missed patient records. Built and enhanced data pipelines using Python, Apache Beam, Google Cloud Dataflow, Pub/Sub, Cloud Spanner, BigQuery, and Cloud Run, achieving end-to-end processing
```

Skills: Python, Apache-Beam, Google-Cloud-Dataflow, Pub-Sub, Cloud-Spanner, BigQuery, Cloud-Run, Data-Pipelines, Healthcare-Data, Idempotent-Processing, Retry-handling, Audit-Logging, Duplicate-Prevention

### Senior Data Engineer

Expedia. Jan 2025 - May 2026

```text
Built an automated data extraction framework for GDPR and HIPAA compliance, reducing manual processing time from 4 hours to under 10 minutes. Optimized ETL pipelines through parallel processing and multithreading, reducing data processing time by 50%.
```

Skills: GDPR, HIPAA, ETL, S3, Lambda, Amazon-EMR, Trino, Parallel-Processing, Multithreading

### Senior Data Engineer

[Reliance Jio](https://himalayas.app/companies/jio-platforms-limited). Aug 2022 - Jan 2025

```text
Led and mentored a team of 4 data engineers to design and optimize large-scale data pipelines. Engineered a cloud-based invoicing platform for dynamic pricing, ensuring accurate monthly billing adjustments and improving invoicing accuracy by 100%.
```

Skills: Apache-Spark, AWS, Azure, GCP, Oracle, JSON, CSV, Parquet, Caching, Multithreading, Broadcast-Joins, Data-Pipelines, Team-Leadership

### Data Engineer

[ZS Associates](https://himalayas.app/companies/zs-associates). Apr 2020 - Jul 2022

```text
Migrated legacy on-premises data processing workflows to the cloud using Apache Spark, reducing processing time by 20%. Conducted in-depth data analysis using Hive, Impala, and Spark SQL, providing SIT/UAT fixes and ensuring smooth operations in the production environment.
```

Skills: Apache-Spark, Hive, Impala, Spark-SQL, Data-Lake, Data-Ingestion, Performance-Optimization, SIT-UAT

### Data Analyst

Standav. Jul 2019 - Mar 2020

```text
Analysed more than 30,000 customer sales data to find the bottlenecks in the business process.
```

Skills: Data-Analysis, Sales-Data, Business-Process-Analysis

## Education

### National Institute of Technology, Tiruchirappalli

Bachelor of Technology, Technology. 2015 - 2019

```text
Pursued a Bachelor of Technology degree at NIT Trichy from 2015 to 2019.
```

## Tech stack

- Apache Spark
- AWS Glue
- Amazon S3
- Kubernetes
- Jenkins
- GitHub Actions
- PySpark
- Oracle
- Hadoop
- Spring Boot
- Databricks
- Terraform
- Azure DevOps
- Python
- Java
- Kotlin
- JSON
- Scala
- Flask
- FastAPI
- Google Cloud Dataflow
- Docker
- Airflow
- Apache Beam
- Amazon EMR
- SQL
- Trino
- Apache Kafka
- AWS
- Azure
- Azure Data Factory

To contact MANISH, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Ambuj Kumar](https://himalayas.app/@ambujkumar1): Senior Data Engineer, British Petroleum
- [Mohan k](https://himalayas.app/@mohank): Senior Data Engineer, Fugetron IT
- [Kannan Thangaraju](https://himalayas.app/@kannanthangaraju): Senior Data Engineer, Fitch Group
- [Aysha Zenab Kenza](https://himalayas.app/@ayshazenabkenza): Data Engineer, Infosys
- [Raj Gandhi](https://himalayas.app/@rajgandhi): Data Engineer I, Amazon
- [shailendra Rathore](https://himalayas.app/@shailendrarathore): Lead Data Engineer, Syren Technologies Pvt Ltd
- [Praneeth madala](https://himalayas.app/@praneethmadala): Snowflake Developer, Tech Mahindra
- [Vijay Parmar](https://himalayas.app/@vijayparmar): Senior Data Engineer, Saama Technologies
- [Pradumna Tamkute](https://himalayas.app/@pradumnatamkute): Consultant, Deloitte USI
- [Meenakshi Saini](https://himalayas.app/@meenakshisaini1): Senior Data Engineer, Infosys Limited
