Skip to main content
HN
Open to opportunities

Hoang Ngo

@hoangngo

Senior Software Engineer with 10+ years scaling distributed systems and web apps.

United States
Message

What I'm looking for

I’m looking to lead architecture and build cloud-native distributed systems—owning backend and full-stack experiences, including LLM/ML enablement—while partnering cross-functionally to ship high-impact features with reliability and security.

I’m a Senior Software Engineer with 10+ years of experience designing, building, and scaling distributed systems and web applications. I focus on software architecture, full-stack development, and cloud-native solutions, and I’m known for delivering high-impact features while leading engineering initiatives across startup and enterprise environments.

At Google, I’ve built inference APIs for the Google Gemini Platform, improving time to first token by 30% through streaming and response pipelining. I also enhanced output consistency and structure for LLM responses across four product surfaces, and created experiment systems for prompt and model evaluation—doubling experiment velocity. In parallel, I optimized request batching and caching, cutting compute cost 15%.

On Google Pay Risk and Fraud, I engineered backend services for transaction processing and risk evaluation, including fraud detection pipelines processing 3k+ QPS that reduced fraud losses 8%. I designed rule and signal systems for real-time risk scoring, improved critical payment latency from 220ms to 160ms, and implemented rollout controls and safeguards that lowered production issues 30%. Earlier, as a Software Architect at BrightInsight (a Flex Company), I directed HIPAA-compliant healthcare backend architecture from 0 to production, established cloud infrastructure and CI/CD pipelines, and defined coding standards for a small team.

Experience

Work history, roles, and key accomplishments

Google logoGO
Current

Software Engineer - Gemini Platform

Apr 2024 - Present (2 years 4 months)

Developed inference APIs for Google Gemini, accelerating time to first token by 30% through streaming and response pipelining. Improved LLM output consistency across 4 product surfaces and cut compute cost 15% via request batching and caching.

Google logoGO

Software Engineer - Health ML Platform

Aug 2020 - Nov 2022 (2 years 3 months)

Built React and TypeScript tools for healthcare ML systems aligned with Google Health, integrating NLP for medical text analysis and cutting manual review effort by 25%. Developed model evaluation and data validation dashboards, reducing analysis time by 40%, and improved frontend performance for large datasets (35% lower render latency).

Education

Degrees, certifications, and relevant coursework

University of Greenwich logoUG

University of Greenwich

Bachelor of Science in Computer Science, Computer Science

2011 - 2014

Earned a Bachelor of Science in Computer Science at the University of Greenwich from 2011 to 2014.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan