# Suki Xiao

Suki Xiao is a remote worker on Himalayas, Staff Software Engineer at AWS, based in United States.

Source: https://himalayas.app/@suqixiao

```text
Staff AI software engineer building scalable LLM/RAG cloud platforms and improving cost, latency, and reliability.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Job categories | Staff Software Engineer, Staff Software Engineer Backend, Software Engineer, AI Engineer, Backend Engineer, Full Stack Engineer, Machine Learning Engineer, Staff Software Developer, Staff Fullstack Software Engineer, Staff Engineer |
| Skills | NodeJS, Lang Chain, Python, TypeScript, JavaScript, Java, Go, SQL, BASH, React, Redux, Next.js, HTML5, fastAPI, Spring Boot, REST APIs, GraphQL, Microservices, Distributed Systems, Kafka, Apache Beam, TensorFlow, NLP, Transformer Models, LLM Integrations, RAG, Prompt Engineering, OpenAI API, AWS AI Bedrock, Vector Search, Semantic Search, AWS, GCP, Docker, Kubernetes, CI CD, GitHub Actions, Terraform, DynamoDB, PostgreSQL, BigTable, Spanner, Redis, CSS, LLM, OpenSearch, Faiss, ETL, Query Optimization, OpenTelemetry, Cloudwatch, Logging, Traces, Observability, Alerting, IAM, KMS, System Design, .NET, AWS Lambda, Beam, GitHub, Loops, Matlab |

## What I'm looking for

```text
I’m looking to lead the engineering of scalable LLM/RAG platforms on cloud-native infrastructure—owning latency, reliability, and cost—while partnering cross-functionally and mentoring teams to ship production AI faster and safer.
```

## About

```text
I’m a Staff Software Engineer with 10+ years of experience delivering production-grade AI systems and cloud-native platforms. I build scalable distributed systems and AI-powered products that translate complex requirements into reliable, measurable outcomes—performance, cost, and speed to ship.

At AWS, I developed a multi-tenant LLM orchestration platform powering enterprise AI copilots for 1K+ concurrent users with sub-300ms response latency. I designed and owned end-to-end RAG (OpenSearch + FAISS), improving answer accuracy by 35% and reducing hallucinations, while optimizing the LLM request lifecycle to cut token usage costs by 28% and increase throughput under peak load.

I also led platform observability and reliability improvements using OpenTelemetry and CloudWatch, reducing MTTR by 40%, and established secure multi-tenant isolation patterns (IAM, KMS, role-based access) for enterprise governance. Earlier at Google, I engineered high-throughput pipelines for large-scale ML training and personalization, modernized frontend architecture with React and TypeScript, and applied ML-based anomaly detection to reduce production incidents by 25%—all while mentoring teams on distributed systems and AI system design.
```

## Experience

### Staff Software Engineer (current)

[AWS](https://himalayas.app/companies/amazon-web-services-aws). Jan 2023 - Present

```text
Developed a multi-tenant LLM orchestration platform for enterprise AI copilots, supporting 1K+ concurrent users with sub-300ms response latency. Designed and operated end-to-end RAG (OpenSearch + FAISS) to improve answer accuracy by 35%, while reducing token costs by 28% through caching, prompt deduplication, and async batching.
```

Skills: Orchestration, RAG, OpenSearch, Faiss, OpenAI-API, DynamoDB, OpenTelemetry, Cloudwatch

### Senior Software Engineer

[Google](https://himalayas.app/companies/google). May 2016 - Jan 2023

```text
Built backend and system design for a large-scale intelligent search platform, improving search relevance and user engagement across multi-billion record datasets. Engineered data pipelines (Kafka + Apache Beam) and low-latency distributed services (Java/Go) for real-time recommendations, and reduced production incidents by 25% with ML-based anomaly detection and proactive monitoring.
```

Skills: Distributed-Systems, Java, Go, Kafka, Apache-Beam, Anomaly-Detection, BigTable, Spanner, React, TypeScript

### Research Assistant

[UC Berkeley](https://himalayas.app/companies/university-of-california-berkeley). Aug 2012 - Apr 2016

```text
Designed and implemented machine learning and optimization models, improving computational efficiency by ~20% for large-scale forecasting and decision systems. Built reusable ETL pipelines and applied statistical modeling and simulation to evaluate performance under uncertainty and varying constraints.
```

Skills: Machine-Learning, ETL, Statistical-Modeling, Data-Analysis, Simulation, Python, Matlab

## Education

### UC Berkeley

Master of Science, Industrial engineering. 2012 - 2013

```text
Completed an M.S. in Industrial engineering at UC Berkeley from 2012 to 2013.
```

### Beijing University of Posts and Telecommunications

Bachelor of Science, Telecommunication Engineering and Management. 2008 - 2012

```text
Earned a B.S. in telecommunication engineering and management from 2008 to 2012.
```

### Queen Mary University of London

Bachelor of Science, Telecommunication Engineering and Management. 2008 - 2012

```text
Earned a B.S. in telecommunication engineering and management from 2008 to 2012.
```

## Tech stack

- GitHub
- Kubernetes
- GitHub Actions
- PostgreSQL
- Gmail
- Node.js
- Spring Boot
- Next.js
- .NET
- Redis
- Terraform
- JavaScript
- HTML5
- Java
- MATLAB
- TensorFlow
- Kafka
- FastAPI
- OpenTelemetry
- GraphQL
- OpenSearch
- AWS Lambda
- Apache Beam
- SQL
- LangChain
- OpenAI API
- Bash
- Faiss
- Loops
- Beam
- Jan

To contact Suki, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Mary Olajoke](https://himalayas.app/@maryolajoke): Staff Software Engineer, Salesforce
- [Steven Yin](https://himalayas.app/@stevenyin): Senior AI Software Engineer, Google
- [Michael Lubich](https://himalayas.app/@michaellubich): Senior Software Engineer, Braintrust Data
- [Mickey Liu](https://himalayas.app/@mickeyliu): Senior Software Engineer, Notion
- [Jonathan Tedesco](https://himalayas.app/@jonathantedesco): Staff Software Engineer, Google
- [Philip Knapp](https://himalayas.app/@philipknapp): Senior Software Engineer, MathWorks
- [Bowen Hong](https://himalayas.app/@bowenhong): Staff Software Engineer, Meta
- [Alex Potts](https://himalayas.app/@alexpotts): Senior Full Stack AI Engineer, Luxoft
- [Miguel Saldana](https://himalayas.app/@miguelsaldana1): Senior Software Engineer (AI & Agentic Systems), SoftServe
- [Qiang Zhang](https://himalayas.app/@qiangzhang): Member of Technical Staff – Foundation Models & AI Systems, OpenAI
