Trung Nguyen

I am a Software Engineer with 8+ years building large-scale distributed systems and machine-learning infrastructure, primarily at Microsoft. I focus on productionizing research models, optimizing inference, and delivering AI-powered features at scale for millions of users.

At Microsoft I reduced P99 inference latency by 22% through batching, caching, and model-serving changes, cut model rollout time from ~2 weeks to ~5 days with automated Azure ML deployments, and improved pipeline runtimes by ~15% for fresher evaluation data. I have built C# microservices on Azure (AKS, Service Bus, Cosmos DB) with 99.9%+ reliability and contributed to experimentation and telemetry pipelines using Azure Data Lake and Spark.

I partner closely with applied scientists, product managers, and Microsoft Research to translate prototypes into production-ready features, mentor junior engineers, and lead design reviews to improve performance, reliability, and operational practices.