Hoang Ngo
@hoangngo
Senior Software Engineer with 10+ years scaling distributed systems and web apps.
What I'm looking for
I’m a Senior Software Engineer with 10+ years of experience designing, building, and scaling distributed systems and web applications. I focus on software architecture, full-stack development, and cloud-native solutions, and I’m known for delivering high-impact features while leading engineering initiatives across startup and enterprise environments.
At Google, I’ve built inference APIs for the Google Gemini Platform, improving time to first token by 30% through streaming and response pipelining. I also enhanced output consistency and structure for LLM responses across four product surfaces, and created experiment systems for prompt and model evaluation—doubling experiment velocity. In parallel, I optimized request batching and caching, cutting compute cost 15%.
On Google Pay Risk and Fraud, I engineered backend services for transaction processing and risk evaluation, including fraud detection pipelines processing 3k+ QPS that reduced fraud losses 8%. I designed rule and signal systems for real-time risk scoring, improved critical payment latency from 220ms to 160ms, and implemented rollout controls and safeguards that lowered production issues 30%. Earlier, as a Software Architect at BrightInsight (a Flex Company), I directed HIPAA-compliant healthcare backend architecture from 0 to production, established cloud infrastructure and CI/CD pipelines, and defined coding standards for a small team.
Experience
Work history, roles, and key accomplishments
Developed inference APIs for Google Gemini, accelerating time to first token by 30% through streaming and response pipelining. Improved LLM output consistency across 4 product surfaces and cut compute cost 15% via request batching and caching.
Engineered backend services for Google Pay transaction processing and risk evaluation, processing 3k+ QPS fraud detection pipelines and reducing fraud losses by 8%. Reduced critical payment path latency from 220ms to 160ms and lowered production issues by 30% with rollout controls and safeguards.
Built React and TypeScript tools for healthcare ML systems aligned with Google Health, integrating NLP for medical text analysis and cutting manual review effort by 25%. Developed model evaluation and data validation dashboards, reducing analysis time by 40%, and improved frontend performance for large datasets (35% lower render latency).
Software Architect
BrightInsight
Jan 2019 - Feb 2020 (1 year 1 month)
Directed architecture and development of HIPAA-compliant healthcare backend services, delivering core systems from 0 to production. Built integration layers and CI/CD pipelines, improving onboarding time by 25% and enabling scalable deployments.
Software Engineer
FPT Software
Jun 2014 - Sep 2018 (4 years 3 months)
Delivered full-stack enterprise applications across finance and retail using TypeScript, Java, Python, and React. Improved key endpoint request latency by 20% and query performance up to 30% through backend optimization and relational database schema tuning.
Education
Degrees, certifications, and relevant coursework
University of Greenwich
Bachelor of Science in Computer Science, Computer Science
2011 - 2014
Earned a Bachelor of Science in Computer Science at the University of Greenwich from 2011 to 2014.
Tech stack
Software and tools used professionally
Apache Spark
Druid
GitHub
Kubernetes
Jenkins
CircleCI
GitHub Actions
MySQL
PostgreSQL
MongoDB
Memcached
Gmail
Rollout
Node.js
Django
Spring Boot
Next.js
Neo4j
Redis
Terraform
Pulumi
Jira
Java
TensorFlow
PyTorch
MLflow
scikit-learn
Kafka
RabbitMQ
FastAPI
Grafana
Prometheus
Datadog
Gemini
GraphQL
NATS
Elasticsearch
Ansible
AWS Lambda
Serverless
sso
Airflow
XGBoost
Hugging Face
LangChain
Jan
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Hoang?
You can contact Hoang and 90k+ other talented remote workers on Himalayas.
Message HoangFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
