Jingyi Ni
@jingyini
Staff software engineer building agentic AI and LLM infrastructure.
What I'm looking for
I’m a Staff Software Engineer with 10+ years across Airbnb, Amazon, and Microsoft, where I’ve specialized in production multi-agent systems, RAG pipelines, and LLM infrastructure. I architect systems end-to-end and ship the code across backend, frontend, and infrastructure.
At Airbnb, I built Airbnb’s production agent runtime from scratch using a custom LangGraph-based stack—planning loops, dynamic tool selection, and long-term memory—then deployed it on AWS with multi-region failover, canary releases, and blue-green rollouts. I also led a 30+ tool ecosystem with schema validation, idempotency, and rollback gates, integrating model routing across Claude, OpenAI, and Llama via AWS Bedrock.
I design the safety and evaluation backbone for agents, including the SafeAgent Router and the Guardrails & Safety Engine for content moderation, prompt injection defense, PII redaction, and policy compliance scoring. I’ve also built evaluation harnesses with offline regression tests and LangSmith trace scoring to prevent regressions, and used RLHF-lite preference fine-tuning to improve task success.
Beyond core agent systems, I’ve shipped agent-facing experiences (like the Agent Console with streaming and human-in-the-loop workflows) and delivered platform improvements through reliability and performance engineering. I’m now looking to build from the ground up at an early-stage company where speed and ownership matter, and where mentoring and technical leadership can compound impact.
Experience
Work history, roles, and key accomplishments
Architected Airbnb’s production agent runtime and safety/guardrails systems, building a hybrid symbolic + LLM router and an evaluation harness to improve agent quality before customer impact. Shipped agent tooling including a Next.js console with streaming and human-in-the-loop workflows, and also led earlier agentic voice and test migration initiatives.
Re-architected the checkout payment system to an event-driven architecture and improved reliability and latency while scaling throughput for peak events. Built logistics tracking and financial reconciliation capabilities for Amazon Fresh transaction processing.
Owned core commerce services for Xbox Store, including cart, checkout, pricing, promotions, and digital entitlements, serving a large monthly active user base. Led performance improvements using async rendering, distributed caching, and parallelized backend calls and built a high-throughput digital entitlement validation service.
Education
Degrees, certifications, and relevant coursework
Carnegie Mellon University
Bachelor of Science, Computer Science
Earned a B.S. in Computer Science from Carnegie Mellon University in 2011.
Tech stack
Software and tools used professionally
GitHub
Kubernetes
GitHub Actions
PostgreSQL
Node.js
Next.js
Redis
Terraform
Java
Kafka
FastAPI
PagerDuty
Grafana
Prometheus
OpenTelemetry
Datadog
GraphQL
gRPC
OpenSearch
Vercel
React Testing Library
Airflow
GuardRails
LangChain
Shadcn/ui
Pinecone
OpenAI API
tRPC
Harness
ArgoCD
Vercel AI SDK
Black
k6
pgvector
Agentic
LangGraph
LangSmith
Loops
100ms
Dynamic
Fresh
Task
Matter
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Jingyi?
You can contact Jingyi and 90k+ other talented remote workers on Himalayas.
Message JingyiGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
