HimalayasHimalayas logo
HN
Open to opportunities

Hoang Ngo

@hoangngo

Senior Software Engineer with 10+ years scaling distributed systems and web apps.

United States
Message

What I'm looking for

I’m looking to lead architecture and build cloud-native distributed systems—owning backend and full-stack experiences, including LLM/ML enablement—while partnering cross-functionally to ship high-impact features with reliability and security.

I’m a Senior Software Engineer with 10+ years of experience designing, building, and scaling distributed systems and web applications. I focus on software architecture, full-stack development, and cloud-native solutions, and I’m known for delivering high-impact features while leading engineering initiatives across startup and enterprise environments.

At Google, I’ve built inference APIs for the Google Gemini Platform, improving time to first token by 30% through streaming and response pipelining. I also enhanced output consistency and structure for LLM responses across four product surfaces, and created experiment systems for prompt and model evaluation—doubling experiment velocity. In parallel, I optimized request batching and caching, cutting compute cost 15%.

On Google Pay Risk and Fraud, I engineered backend services for transaction processing and risk evaluation, including fraud detection pipelines processing 3k+ QPS that reduced fraud losses 8%. I designed rule and signal systems for real-time risk scoring, improved critical payment latency from 220ms to 160ms, and implemented rollout controls and safeguards that lowered production issues 30%. Earlier, as a Software Architect at BrightInsight (a Flex Company), I directed HIPAA-compliant healthcare backend architecture from 0 to production, established cloud infrastructure and CI/CD pipelines, and defined coding standards for a small team.

Experience

Work history, roles, and key accomplishments

Google logoGO
Current

Software Engineer - Gemini Platform

Apr 2024 - Present (2 years)

Developed inference APIs for Google Gemini, accelerating time to first token by 30% through streaming and response pipelining. Improved LLM output consistency across 4 product surfaces and cut compute cost 15% via request batching and caching.

Google logoGO

Software Engineer - Health ML Platform

Aug 2020 - Nov 2022 (2 years 3 months)

Built React and TypeScript tools for healthcare ML systems aligned with Google Health, integrating NLP for medical text analysis and cutting manual review effort by 25%. Developed model evaluation and data validation dashboards, reducing analysis time by 40%, and improved frontend performance for large datasets (35% lower render latency).

Education

Degrees, certifications, and relevant coursework

University of Greenwich logoUG

University of Greenwich

Bachelor of Science in Computer Science, Computer Science

2011 - 2014

Earned a Bachelor of Science in Computer Science at the University of Greenwich from 2011 to 2014.

Availability

Open to opportunities

Location

United States

Authorized to work in

Interested in hiring Hoang?

You can contact Hoang and 90k+ other talented remote workers on Himalayas.

Message Hoang

People also viewed

View all talent

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan