# Arpan Samariya

Arpan Samariya is a remote worker on Himalayas, Data Engineer III at Zepto, based in India.

Source: https://himalayas.app/@arpansamariya

```text
Data Engineer at Zepto building real-time pipelines that handle 16M RPM for user experimentation and campaign audiences.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 9965k+ INR |
| Job categories | Data Engineer, Data Platform Engineer, Data Infrastructure Engineer |
| Skills | Data Engineering, Data Lakehouse Architecture, Real Time Data Streaming, ETL, Change Data Capture, Data Modeling, Data Quality, Apache Spark, Spark Streaming, Kafka, Databricks, Apache Iceberg, Apache Hudi, Clickhouse, Apache Flink |
| LinkedIn | https://linkedin.com/in/arpan-samariya |
| GitHub | https://github.com/ArpanSamariya |

## About

```text
At Zepto, I architect Spark Streaming frameworks with alerting, monitoring, and retries, including pipelines handling 16M RPM for user experimentation and campaign audiences with 800+ attributes per user.

I also moved workloads to Iceberg tables, built CDC ingestion and data quality frameworks, and developed an API-driven job creation framework that cut deployment time from one day to 10 minutes.

At HealthifyMe, I created a CDC-enabled Hudi data lake and supported the migration of 500+ OLTP tables to AWS DMS. I also managed a 4-node Redshift cluster, achieving 30% cost savings, and earned the Databricks Certified Data Engineer Professional certification.
```

## Experience

### Data Engineer III (current)

Zepto. Aug 2024 - Present

```text
Architected real-time analytics for 1 billion daily events at 500k RPM within 2-minute SLA using ClickHouse. Pioneered Iceberg adoption and delivered Spark Streaming pipelines handling 16M RPM throughput.
```

Skills: Kafka, PySpark, Databricks, CDC, Clickhouse, Spark-Streaming, Python, Data-Quality, Terraform, Cloudwatch, Grafana, SQL, Data-Structures, IAM, Connectors, Data-Lake, Lakehouse, ETL, AWS, PostgreSQL, Data-Modeling, Warehouse, Alerting, Infra

### SDE - Data Engineer I

HealthifyMe. Apr 2022 - Jul 2024

```text
Created Hudi managed data lake with change data capture for MySQL RDS using DMS. Directed migration of 500+ OLTP tables to AWS DMS and managed a 4-node Redshift cluster achieving 30% cost savings.
```

Skills: Hudi, AWS-DMS, Redshift, Terraform, Cloudwatch, Slack, Tableau, Metabase, Databricks, EMR, Glue, Kinesis, SQL, Data-Modeling, ETL, Data-Quality

## Education

### National Institute of Technology, Hamirpur

Bachelor of Technology, Computer Science and Engineering. 2016 - 2020. Grade: 8.58

Activities and societies: Vice President, ISTE Students' Chapter; Finance Head, TEDxNITH; Member of Organizing, Speaker Curation and Finance Team in first ever TEDx talk at NITH.

```text
Pursued a Bachelor of Technology in Computer Science and Engineering, graduating with a grade of 8.58.
```

## Tech stack

- Amazon Redshift
- Apache Spark
- AWS Glue
- Apache Flink
- Tableau
- Metabase
- Amazon CloudWatch
- Debezium
- PostgreSQL
- Databricks
- Slack
- Terraform
- Python
- Kafka
- Grafana
- Amazon Kinesis
- Protobuf
- Amazon EMR
- SQL
- Clickhouse
- Apache Iceberg
- Great Expectations
- Apache Hudi
- Apache Kafka
- AWS

To contact Arpan, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Lavanaya dayala](https://himalayas.app/@lavanayadayala): Senior Data Engineer, Accenture
- [Praveen Kumar](https://himalayas.app/@praveen-yadav): Data Engineer II, Aidetic Software Private Limited
- [Gunj Desai](https://himalayas.app/@gunjdesai): Engineering Manager, HackerRank
- [Saumya Ranjan](https://himalayas.app/@saumyaranjan1): Data Engineer, Axis Bank
- [ashish kumar](https://himalayas.app/@ashishkumar39): Data Engineer, Workday
- [Madhan Lingareddy](https://himalayas.app/@madhanreddy575): Senior Data Engineer, Procore Technologies
- [Harish Rajoori](https://himalayas.app/@harishrajoori): Staff Data Engineer, Warner Bros. Discovery
- [Abhiraj Karpe](https://himalayas.app/@abhirajkarpe): Software Engineering Intern, Jio Platforms Limited
- [Abhijit Patra](https://himalayas.app/@abhijitpatra1): Lead Data Engineer, PayNearby
- [Aditi Vaidya](https://himalayas.app/@aditivaidya): Senior Data Engineer, Konverge.AI
