# Rohit Agarwal

Rohit Agarwal is a remote worker on Himalayas, Junior Data Engineer at Spark Eighteen, based in India.

Source: https://himalayas.app/@rohitagarwal1

```text
Data Engineer at Spark Eighteen building DataShield, an on-device PII/PHI de-identification platform.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 900k+ INR |
| Job categories | Data Engineer, DevOps Engineer |
| Skills | Data Engineering, ETL Pipelines, Airflow, PySpark, Apache Spark, Kafka, Apache Iceberg, Medallion Architecture, Data Modeling, AWS, AWS Glue, EMR Serverless, S3, Amazon RDS, Amazon Aurora |
| LinkedIn | https://linkedin.com/in/rohitagarwal2610 |
| GitHub | https://github.com/rohitagr0310 |

## About

```text
At Spark Eighteen, I built DataShield, an on-device platform for de-identifying PII and PHI. It uses custom recognizers and policy-based operators, and processes large files in AES-256-GCM encrypted shards without writing plaintext PII to disk.

I also built a property data pipeline for RTS (RealT Services), using Playwright to collect county-site records and Airflow to process 32 counties in parallel into a standard schema. Before that, as a Data Engineer Intern at Spark Eighteen, I wrote Airflow DAGs and PySpark jobs for Kafka IoT events, with checkpointing to resume failed micro-batches.

My projects include an AWS Medallion lakehouse pipeline with data quality checks and an automated script-to-video pipeline. I use Claude Code to plan and review work, splitting tasks across parallel agents and checking their output against tests.
```

## Experience

### Junior Data Engineer (current)

Spark Eighteen. Apr 2026 - Present

```text
Built DataShield, a PII/PHI de-identification tool with custom recognizers and operators, and developed a property data pipeline for a client using Playwright and Airflow. Utilized Claude Code for planning, parallel subagents, and review.
```

Skills: PySpark, Airflow, Playwright, XGBoost, AES-256-GCM, HIPAA, GDPR, CCPA, PCI-DSS, Claude-Code

### Data Engineer Intern

Spark Eighteen. Sep 2025 - Mar 2026

```text
Wrote Airflow DAGs and PySpark jobs for IoT sensor data processing through Bronze, Silver, and Gold layers. Implemented retries and checkpoints for fault-tolerant streaming.
```

Skills: Airflow, PySpark, Kafka, Spark-Structured-Streaming

## Education

### Techno India NJR Institute of Technology

Bachelor of Technology, Computer Science and Engineering. 2022 - 2026

```text
Pursued a Bachelor of Technology in Computer Science and Engineering from 2022 to 2026.
```

## Tech stack

- Apache Spark
- AWS Glue
- Amazon S3
- GitHub
- Kubernetes
- PySpark
- MySQL
- PostgreSQL
- MongoDB
- Next.js
- Redis
- Terraform
- Python
- Kafka
- FastAPI
- SpaCy
- Linux
- Amazon RDS
- Amazon Aurora
- Git
- Docker
- Airflow
- SQL
- XGBoost
- Apache Iceberg
- Playwright
- Make
- Claude Code
- Apache Kafka
- AWS

To contact Rohit, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Kaushik Tiwari](https://himalayas.app/@kaushiktiwari): Software Development Engineer II, Baazi Games
- [Pusala dinesh](https://himalayas.app/@pusaladinesh): SDE 2 | Data Engineering, Sigmoid Analytics
- [Anupam Srivastava](https://himalayas.app/@anupamsrivastava): Data Engineer, Piramal Finance
- [043 Eshan Shrivastava](https://himalayas.app/@eshanshrivastava): Data Engineering Consultant, Deloitte USI
- [Karan Kamat](https://himalayas.app/@karankamat): Data Engineer, Jio Platforms Ltd.
- [Kajal Kumari](https://himalayas.app/@kajalkumari7): Data Engineer (PySpark), Mavenir
- [Abhiraj Karpe](https://himalayas.app/@abhirajkarpe): Software Engineering Intern, Jio Platforms Limited
- [Aditi Vaidya](https://himalayas.app/@aditivaidya): Senior Data Engineer, Konverge.AI
- [Rutuja Shelke](https://himalayas.app/@rutujashelke1): Data Engineer, Network Techlab India Pvt. Ltd.
- [Manjari Sarkar](https://himalayas.app/@manjarisarkar): Senior Data Engineer, PwC India
