Ayden Green
@aydengreen
Senior AI & Software Engineer building scalable LLM infrastructure and developer platforms for production-grade AI.
What I'm looking for
I’m a Senior Software Engineer with 10+ years building AI infrastructure, distributed backend systems, developer platforms, and full-stack SaaS products across startups and enterprise cloud environments.
Most recently, I architected backend infrastructure for OpenRouter Fusion—enabling real-time parallel dispatch across multiple LLM providers with a consensus-based evaluation layer. I optimized high-concurrency inference routing across 400+ models and 60+ providers, reducing median platform overhead by 18%, and built failover, latency-aware routing, and dynamic response caching to improve reliability, throughput, and cost efficiency.
At Hebbia, I designed and implemented a v1 multi-agent orchestration engine for complex legal, regulatory, and financial research. I built production document-intelligence pipelines for multi-thousand-page corpora, developed multimodal extraction for tabular financial data with deterministic source citations, and partnered with Product and AI Research to operationalize evaluation for factuality, citation accuracy, and extraction quality.
Previously at Microsoft and Infosys, I contributed to Azure Machine Learning Service (including AutoML pipeline functionality ahead of General Availability), re-architected cloud microservices using .NET Core/C#/Kubernetes for high-availability workloads, and built secure full-stack banking applications. I’m product-minded and technical, and I enjoy owning architecture and mentoring engineers through scalable design, onboarding, and production-readiness practices.
Experience
Work history, roles, and key accomplishments
Senior AI & Software Engineer
OpenRouter
Jul 2024 - Present (1 year 11 months)
Built AI infrastructure for OpenRouter Fusion, including parallel LLM dispatch, provider failover, latency-aware routing, dynamic caching, and developer APIs across 400+ models and 60+ providers, reducing platform overhead and improving reliability for production LLM apps.
Senior AI Engineer
Hebbia
Apr 2021 - Jul 2024 (3 years 3 months)
Designed Hebbia’s v1 multi-agent orchestration engine for Matrix, turning complex legal, financial, and regulatory research into asynchronous AI workflows with cited answers, document intelligence, extraction pipelines, and evaluation systems for factuality and auditability.
Built backend services and Python SDK components for Azure Machine Learning, including AutoML pipeline functionality, experiment tracking, model workflow execution, and cloud microservices on .NET Core, Kubernetes, and Azure for enterprise-scale ML infrastructure.
Developed secure full-stack banking applications for global financial clients using Java, Spring, Hibernate, Oracle, and AngularJS, building transactional business logic, dashboards, reusable components, data pipelines, and automation workflows for enterprise finance systems.
Built and scaled Zapier’s early automation infrastructure using Python, Django, Redis, RabbitMQ, and MySQL, including async task execution, high-volume webhook receivers, polling systems, and the v1 Developer Platform that let SaaS vendors build integrations independently.
Education
Degrees, certifications, and relevant coursework
University of California, Berkeley
Bachelor's degree, Computer Science
Completed a bachelor's degree in Computer Science at the University of California, Berkeley.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Skills
Interested in hiring Ayden?
You can contact Ayden and 90k+ other talented remote workers on Himalayas.
Message AydenFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
