# Nipun Garg

Nipun Garg is a remote worker on Himalayas, Principal Member of Technical Staff at Oracle, based in India.

Source: https://himalayas.app/@nipungarg

```text
Principal software engineer at Oracle building OCI’s LLM hosting platform, with model delivery throughput increased from 70 Mbps to 1.3 Gbps.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 7995k+ INR |
| Job categories | Principal Software Engineer |
| Skills | Distributed Systems, AI Platform Engineering, Machine Learning Platform Engineering, Generative AI, Agentic AI, Microservices Architecture, Event Driven Architecture, Model Hosting, Model Deployment, Inference Serving, Java, Go, Spring Boot, Spring MVC, Hibernate |
| LinkedIn | https://linkedin.com/in/nipungarg90 |

## About

```text
At Oracle, I’m leading engineering work on Oracle Data Science’s ML and LLM hosting infrastructure on OCI. I designed multi-model hosting for LLaMA 2, Mistral, and Falcon, reducing hosting costs for smaller models by 4x.

I integrated Triton Inference Server, Text Generation Inference, and vLLM into OCI Data Science. I also built a parallel chunked model-download pipeline in Go that increased throughput from 70 Mbps to 1.3 Gbps.

At Nike, I led the migration of a legacy Java/J2EE order management platform to cloud-native microservices on AWS. I built an event-driven order notification service that scaled from thousands to millions of events per day, and automated failed-event reprocessing to save about $6K per year.

At HSBC, I led six Java engineers migrating telephony components to the Next Generation Telephony platform and integrated voice biometrics for US and Mexico customers. Earlier, at Tech Mahindra, I built Java services for a Telecom CRM and delivered its three-tier application architecture.
```

## Experience

### Principal Member of Technical Staff (current)

[Oracle](https://himalayas.app/companies/oracle). Apr 2022 - Present

```text
Engineering Lead for Oracle Data Science platform on OCI, building enterprise-grade ML & LLM hosting infrastructure. Designed multi-model hosting solution reducing hosting cost by 4x and cut model bootstrapping time by 70%.
```

Skills: Java, Spring-Boot, Go, Kubernetes, OCI, VLLM, TGI, Triton-Inference-Server, Generative-AI, LLM, Distributed-Systems, Microservices, Terraform, Docker

### Software Development Engineer 3

[Nike](https://himalayas.app/companies/nike). Feb 2021 - Apr 2022

```text
Backend engineering lead for Nike's global Order Management System, modernizing a legacy Java monolith into cloud-native microservices on AWS. Led migration to microservices and built event-driven order notification service scaling to millions of events per day.
```

Skills: Java, Spring-Boot, AWS, Amazon-SQS, Lambda, Terraform, CloudFormation, Kubernetes, Amazon-EKS, Groovy, Microservices, Event-Driven-Architecture

### Consultant Specialist (Tech Lead)

[HSBC](https://himalayas.app/companies/hsbc). Jun 2016 - Feb 2021

```text
Technical Lead for a team of 6 engineers on HSBC's global Next Generation Telephony (NGT) transformation. Designed and integrated Voice Biometric authentication and optimized Java banking workflows, reducing call handling time by 30%.
```

Skills: Java, J2EE, Spring-Framework, Hibernate, Terraform, AWS, EC2, Amazon-EKS, Lambda, 2-Factor-Authentication, Voice-Biometrics

### Software Engineer

[Tech Mahindra](https://himalayas.app/companies/tech-mahindra). Jan 2014 - Jun 2016

```text
Full-stack Java developer building a CRM product for a Norwegian Telecom enterprise customer using Spring, Hibernate, and React. Built RESTful backend services and automated 60% of manual release management.
```

Skills: Java, J2EE, Spring-MVC, Hibernate, React, MySQL, Apache-HTTP-Server, IBM-Websphere, Perl, Nagios, SSL

## Education

### Centre for Development of Advanced Computing

Post Graduate Diploma in Advanced Computing, Advanced Computing. 2013 - 2014

```text
Post Graduate Diploma in Advanced Computing (PGDAC) from C-DAC, Centre for Development of Advanced Computing, 2013-2014.
```

### S.D. College of Engineering & Technology

B.Tech., Computer Science Engineering. 2008 - 2012

```text
B.Tech. in Computer Science Engineering from S.D. College of Engineering & Technology, 2008-2012.
```

## Tech stack

- Amazon EC2
- Kubernetes
- Amazon EKS
- MySQL
- Spring Boot
- Spring MVC
- Terraform
- React
- Python
- Java
- Perl
- Go
- Amazon SQS
- FastAPI
- Nagios
- Hibernate
- GraphQL
- AWS Lambda
- Docker
- Apache HTTP Server
- GlassFish
- Hugging Face
- vLLM
- NVIDIA TensorRT-LLM
- NVIDIA NIM
- Falcon
- AWS

To contact Nipun, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Hannah Abraham](https://himalayas.app/@hannahabraham): Principal Application Engineer, Oracle India Pvt Ltd
- [Kalaiyarasan Venkatesan](https://himalayas.app/@kalaiyarasanvenkates): Principal Engineer, Cloud Software Group (Formerly Citrix)
- [Mohammad Shuphiyan](https://himalayas.app/@mohammadshuphiyan): Advanced Technologist, Boeing India Private Limited
- [Akshat Sarawgi](https://himalayas.app/@akshatsarawgi): Member of Technical Staff, Oracle
- [rishi srivastav](https://himalayas.app/@rishisrivastav): Principal Software Engineer, Delta Air Lines
- [ranjan sen](https://himalayas.app/@ranjansen): Principal Member of Technical Staff, Oracle
- [Ganesh Narayanamurthy](https://himalayas.app/@ganeshnarayanamurthy): Principal Member Technical Staff, Oracle
- [Santhosh Kumar](https://himalayas.app/@santhoshkumar24): Software Developer – AI Platforms and Java Technology, IBM
- [Akash Muduli](https://himalayas.app/@akashmuduli): Senior Principal Software Engineer, Oracle India Pvt. Ltd.
- [MASUD AHMED KHAN](https://himalayas.app/@masudahmedkhan): Senior Software Engineer/ Tech Lead, Adidas
