Open to opportunities

Danny Nguyen

@dannynguyen

Message

Software engineer shipping production ML inference and clinician-facing AI products.

United States

Message

What I'm looking for

I’m looking for a role where I can build end-to-end production ML systems—serving, observability, and product UX—so model outputs reliably reach clinicians and customers with low latency and measurable impact.

I’m a software engineer (10+ years) focused on where ML inference meets real product needs—serving infrastructure that runs models in production and the interface layer that puts outputs in front of the people who act on them.

At Aidoc, I shipped FDA-cleared clinical imaging models on the aiOS platform, building a production serving pipeline on AWS EKS with containerized deployment, autoscaling, real-time routing, and end-to-end monitoring in Prometheus and Grafana. I onboarded new AI models into aiOS via a single integration API, gated releases with MLflow tracking and pytest checks, and expanded clinician workflows with React widgets and prioritized, time-critical findings.

Earlier, at Amazon, I built core SageMaker serving and RAG infrastructure—then tuned 70B-class LLM inference for lower latency and cost. At Microsoft, I helped carry Teams messaging backends through the pandemic surge to 145M+ daily active users, combining reliability engineering with product delivery using modern Azure microservices and APIs.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer

Current

Aidoc

Oct 2024 - Present (1 year 8 months)

Shipped Aidoc’s PyTorch clinical imaging models into AWS EKS production with autoscaling and real-time routing, monitoring end-to-end via Prometheus and Grafana. Built clinician-facing React worklists and care-escalation features, integrating new models through a single API gated by MLflow tracking and pytest, and deploying across 150+ health systems.

PyTorch Kubernetes fastAPI React MLFlow Prometheus Grafana

Senior Software Engineer

Amazon

Sep 2021 - Sep 2024 (3 years)

Built the Amazon SageMaker console and public API enabling customers to configure, deploy, and monitor ML models in production. Delivered model-serving and RAG on SageMaker/Bedrock, including TensorRT-LLM optimization that reduced LLM latency ~30% and increased throughput ~60% on 70B-class models.

React TypeScript Java Spring Boot Amazon SageMaker AWS ECS Bedrock Knowledge Bases TensorRT

Software Engineer

Microsoft

Oct 2017 - Aug 2021 (3 years 10 months)

Delivered real-time messaging, presence, and notification backends across the Microsoft Teams stack, supporting growth from ~20M to 145M+ daily active users. Implemented collaboration features via SPFx and Microsoft Graph, and built Azure Functions/Cosmos DB/AKS microservices with CI/CD testing to improve reliability and reduce latency.

TypeScript C#.NET Core Azure Functions Azure Service Bus Cosmos AKS Microsoft Graph

Software Engineer

Spotio

Jun 2015 - Mar 2017 (1 year 9 months)

Built CRM and lead-management features in PHP/Laravel for field-sales workflows, including a Redis-backed lead-scoring engine to prioritize high-conversion prospects. Developed responsive web experiences and REST APIs to sync leads and visit activity in real time with a companion mobile app, and optimized MySQL queries for faster territory dashboards.