# Vivek Sharma

Vivek Sharma is a remote worker on Himalayas, Senior Data Platform Engineer (P3 / SDE 3) at New Relic, based in India.

Source: https://himalayas.app/@viveksharma21

```text
I build high-throughput cloud data platforms that improve reliability, speed, and developer productivity.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | India |
| Job categories | Data Engineer, Software Engineer, Data Engineer, Platform Engineer, Cloud Engineer, Backend Engineer, DevOps Engineer, Site Reliability Engineer, Data Engineer Jobs, Data Engineering, Data Engineering Specialist, Data Engineering Jobs, Data Engineering Positions |
| Skills | Python, Java, Go, SQL, NoSQL, AWS, Kafka, Apache Iceberg, Spark, Airflow, Terraform, Kubernetes, Fivetran, Snowflake, Databricks, Spring Boot, fastAPI, Amazon SQS, AWS Step Functions, Docker, Linux, Flask, Prometheus, Loki, Grafana, Minio, Apache Doris, Protobuf, Data Structures, Multithreading, Test Driven Development, CI CD, JSON, IBM Cloud, Zuora, New Relic, Black |
| LinkedIn | https://https://www.linkedin.com/in/vivek-sharma-/ |

## About

```text
At New Relic, I architect and migrate billing and subscription pipelines supporting SaaS vendors and $1B+ in annual revenue. I reduced NRDB data-processing latency from one week to under four hours using Spark and Apache Iceberg, and led Kafka pipeline migrations from JSON to Protobuf that cut cloud storage and compute overhead by 30%.

Previously at CommerceIQ and IBM Cloud, I built and operated data, streaming, and cloud-platform systems at scale. I've led zero-downtime migrations, reduced retailer onboarding from three weeks to two days, built streaming systems handling 10 million daily messages, and developed a real-time arbitrage platform processing 250k+ peak events per second.
```

## Experience

### Senior Data Platform Engineer (P3 / SDE 3) (current)

[New Relic](https://himalayas.app/companies/new-relic). Aug 2024 - Present

```text
Architected and migrated core billing and subscription data pipelines from Zuora to Billing Platform, securing data foundational to $1B+ in annual revenue. Designed an optimised NRDB ingestion architecture with Spark and Apache Iceberg, reducing processing latency from 1 week to under 4 hours.
```

Skills: Python, Java, Kafka, Iceberg, Spark, Airflow, Terraform, Kubernetes, Fivetran, Snowflake

## Education

### Guru Gobind Singh Indraprastha University

Bachelor of Technology, Electronics and Communication Engineering. 2016 - 2020

Activities and societies: President of Coding Club; Winner of HackerEarth Machine Learning & NLP Challenge among 4500+ participants.

```text
Pursued a Bachelor of Technology in Electronics and Communication Engineering, graduating in 2020.
```

## Tech stack

- Fivetran
- Kubernetes
- Databricks
- Terraform
- Java
- JSON
- Loki
- Kafka
- FastAPI
- Grafana
- Prometheus
- Linux
- New Relic
- Protobuf
- Airflow
- SQL
- IBM Cloud
- Zuora
- Apache Iceberg
- MinIO
- Black

To contact Vivek, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Arun K C](https://himalayas.app/@arunkc1): Open Source Contributor, naas.ai
- [Ganesh Hemanth](https://himalayas.app/@ganeshhemanth): Senior Data Engineer, Goldman Sachs
- [rahul lohia](https://himalayas.app/@rahullohia): Senior Data Engineer, Affine Analytics
- [Amisha Tripathy](https://himalayas.app/@amishatripathy): Software Engineering Intern, Microsoft
- [Jitesh Mogre](https://himalayas.app/@jiteshmogre): Staff Data Platform Engineer, GumGum
- [Tarun Yellapu](https://himalayas.app/@tarunyellapu): Data Engineer II, Guardant Health
- [Gokul Arumugam](https://himalayas.app/@gokularumugam): Data Engineer (PSE), PhonePe
- [Chetan Mittal](https://himalayas.app/@chetanmittal): Software Engineer, Amdocs
- [Amritanshu Jha](https://himalayas.app/@amritanshujha): Senior Software Engineer, Salesforce
- [Abhijit Patra](https://himalayas.app/@abhijitpatra1): Lead Data Engineer, PayNearby
