At Route AI, I co-founded the company and led a small engineering team from product design through launch and ongoing operations. I designed Python/Flask APIs for a unified gateway to hundreds of open-source LLMs across multiple providers, serving 10,000+ daily users.
I built provider integrations, fallback logic, and a model-selection workflow that considers task complexity, location, budget, availability, latency, and cost. I also developed compatibility, deployment, load, and failover testing for hosted and self-managed LLM integrations.
At Amazon Web Services, I led delivery of a migration platform that enabled traffic migration from more than 10,000 hardware load balancers to managed ELB, saving Amazon more than $50 million in operating costs. I also led Tier-1 operations for systems carrying more than 10 Tbps of traffic and designed routing, automation, and operational data services.
