Skip to main content
NG
Looking for a job

Nipun Garg

@nipungarg

Principal software engineer at Oracle building OCI’s LLM hosting platform, with model delivery throughput increased from 70 Mbps to 1.3 Gbps.

India
Message

At Oracle, I’m leading engineering work on Oracle Data Science’s ML and LLM hosting infrastructure on OCI. I designed multi-model hosting for LLaMA 2, Mistral, and Falcon, reducing hosting costs for smaller models by 4x.

I integrated Triton Inference Server, Text Generation Inference, and vLLM into OCI Data Science. I also built a parallel chunked model-download pipeline in Go that increased throughput from 70 Mbps to 1.3 Gbps.

At Nike, I led the migration of a legacy Java/J2EE order management platform to cloud-native microservices on AWS. I built an event-driven order notification service that scaled from thousands to millions of events per day, and automated failed-event reprocessing to save about $6K per year.

At HSBC, I led six Java engineers migrating telephony components to the Next Generation Telephony platform and integrated voice biometrics for US and Mexico customers. Earlier, at Tech Mahindra, I built Java services for a Telecom CRM and delivered its three-tier application architecture.

Experience

Work history, roles, and key accomplishments

Education

Degrees, certifications, and relevant coursework

Centre for Development of Advanced Computing logoCC

Centre for Development of Advanced Computing

Post Graduate Diploma in Advanced Computing, Advanced Computing

2013 - 2014

Post Graduate Diploma in Advanced Computing (PGDAC) from C-DAC, Centre for Development of Advanced Computing, 2013-2014.

ST

S.D. College of Engineering & Technology

B.Tech., Computer Science Engineering

2008 - 2012

B.Tech. in Computer Science Engineering from S.D. College of Engineering & Technology, 2008-2012.

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

7995k+ INR

Interested in hiring Nipun?

You can contact Nipun and 600K+ other talented remote workers on Himalayas.

Message Nipun

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan