# Xinning Shen

Xinning Shen is a remote worker on Himalayas, Staff Software Engineer - GKE AI Infrastructure Lead at Google, based in United States.

Source: https://himalayas.app/@xinningshen

```text
I build GKE AI infrastructure that puts large-scale TPU training workloads into production.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 168k+ USD |
| Job categories | Software Engineer, Infrastructure Engineer, Distributed Systems Engineer, Cloud Engineer, Machine Learning Infrastructure Engineer |
| Skills | Go, Python, Java, C++, SQL, TypeScript, JavaScript, BASH, Shell, Google Cloud Platform, Google Kubernetes Engine, AWS, Linux, Kubernetes, Docker, Helm, Kustomize, Argo, gVisor, Borg, Envoy, Istio, gRPC, Protocol Buffers, TPU, Trillium, GPU, CUDA, NCCL, Jax, XLA, PyTorch, PyTorch XLA, Kubeflow, Ray, S3, Amazon Aurora, Spanner, BigTable, BigQuery, Etcd, RethinkDB, Bazel, Terraform, Git, CI CD, Prometheus, Grafana, Datadog, Apache Spark, Django, OpenCV, Distributed Systems, Cloud Control Planes, AI Infrastructure, Storage Infrastructure, Database Internals, Observability, Data Repair, Data Migration, Parallel Processing |

## About

```text
At Google, I lead GKE AI infrastructure across three product surfaces and guide a team of six engineers. I was the founding engineer for TPU support on Google Kubernetes Engine.

I shipped managed TPU v4, v5e, v5p, and Trillium support across tens of thousands of schedulable chips running JAX, XLA, and PyTorch/XLA workloads. I redesigned the Go node-pool lifecycle path, reducing provisioning from 18 to 6 minutes and time to first training job by 65%.

Previously, I built GKE control-plane services for a six-figure cluster fleet and reduced cluster-upgrade failures by 40%. At Amazon, I worked on exabyte-scale S3 durability and control planes, Alexa self-learning infrastructure, and Aurora database internals.

My work spans Go, Kubernetes, gRPC, cloud control planes, storage systems, and AI infrastructure. I’ve built systems that move petabytes per day, serve tens of millions of daily requests, and support production machine-learning workloads at scale.
```

## Experience

### Staff Software Engineer - GKE AI Infrastructure Lead (current)

[Google](https://himalayas.app/companies/google). May 2025 - Present

```text
Lead GKE AI infrastructure across three product surfaces, guiding a team of six engineers. Founding engineer for TPU support on GKE, shipping managed support for TPU v4, v5e, v5p, and Trillium across tens of thousands of schedulable chips.
```

Skills: GKE, Kubernetes, TPU-V4-V5e-V5p, Trillium, Jax, XLA, PyTorch, Go, gRPC

### Senior Software Engineer

[Google](https://himalayas.app/companies/google). Nov 2022 - Apr 2025

```text
Built the foundational TPU resource integration on GKE that every later accelerator generation was layered on top of. Took TPU node pools from first managed release to broad adoption across the managed Kubernetes fleet inside twelve months.
```

Skills: GKE, Kubernetes, TPU, Node-Pools, Go, Bazel, Borg, CI-CD

### Software Engineer - GKE Control Plane

[Google](https://himalayas.app/companies/google). Apr 2020 - Nov 2022

```text
Developed managed control-plane services in Go over gRPC for a customer Kubernetes fleet at six-figure cluster scale. Shipped cluster orchestration and lifecycle management with Prometheus-based observability, reducing cluster-upgrade failures by 40%.
```

Skills: GKE, Control-Plane, Go, gRPC, Borg, Prometheus

### Software Development Engineer - Amazon S3

[Amazon](https://himalayas.app/companies/amazon). Apr 2019 - Apr 2020

```text
Engineered Amazon S3 storage infrastructure and control-plane systems operating at exabyte scale. Delivered a core component of an S3 storage initiative launched at AWS re:Invent 2019 on a six-month timeline.
```

Skills: AWS, S3, Storage-Infrastructure, Control-Plane

### Software Development Engineer - Alexa AI & Machine Learning

[Amazon](https://himalayas.app/companies/amazon). Sep 2018 - Apr 2019

```text
Built and launched Alexa's next-generation self-learning platform, reducing manual annotation effort by 60% across eight locales. Developed the production services behind Alexa AI and machine-learning workflows at tens of millions of daily requests.
```

Skills: Machine-Learning-Platforms, Self-Learning-Systems, CI-CD, Production-Deployment

### Software Development Engineer - RDS Aurora

[Amazon](https://himalayas.app/companies/amazon). Apr 2016 - Dec 2016

```text
Improved the Amazon Aurora lock manager, raising write throughput 12% under high-contention workloads. Wrote the metrics and crash-investigation tooling that took database-engine root-cause time from days to hours.
```

Skills: Amazon-Aurora, Database-Internals, Concurrency-Control, Observability

### Software Engineer

BloomSky, Inc.. Jun 2015 - Sep 2015

```text
Implemented fisheye-lens calibration, sky-region color and edge detection, and sun-track detection with OpenCV for a weather-forecasting image pipeline. Deployed a parallel cloud-cover algorithm across 500+ field devices and built an image-retrieval web application backed by RethinkDB.
```

Skills: OpenCV, Apache-Spark, Django, RethinkDB, Parallel-Processing

## Education

### University of California, Irvine

Master's Degree, Computer Science. 2014 - 2016

```text
Master's Degree in Computer Science from the University of California, Irvine from 2014 to 2016.
```

### Fudan University

Master's Degree, Telecommunications Engineering. 2011 - 2014

```text
Master's Degree in Telecommunications Engineering from Fudan University from 2011 to 2014.
```

### Donghua University

Bachelor of Engineering, Telecommunications Engineering. 2007 - 2011

```text
Bachelor of Engineering in Telecommunications Engineering from Donghua University from 2007 to 2011.
```

## Tech stack

- Apache Spark
- Google Cloud Platform
- Amazon S3
- Kubernetes
- Helm
- Argo
- Borg
- Django
- OpenCV
- Terraform
- Bazel
- JavaScript
- Python
- Java
- Go
- C++
- PyTorch
- Kubeflow
- Istio
- Grafana
- Prometheus
- etcd
- Linux
- Datadog
- gRPC
- Shell
- Amazon Aurora
- TypeScript
- Git
- Docker
- CUDA
- SQL
- Google Kubernetes Engine
- Envoy
- Envoy
- Ray
- JAX
- Bash
- Kustomize

To contact Xinning, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Ansel Jackson](https://himalayas.app/@anseljackson): AI Engineer | Full Stack Developer, Google Cloud
- [Guoteng Rao](https://himalayas.app/@guotengrao): Senior Machine Learning Infrastructure Engineer, Poni.ai
- [Terry Fu](https://himalayas.app/@terryfu): Senior Software Engineer, Databricks
- [Miguel Saldana](https://himalayas.app/@miguelsaldana1): Senior Software Engineer (AI & Agentic Systems), SoftServe
- [Bowei Wang](https://himalayas.app/@boweiwang): Senior Software Engineer, Google
- [Qiang Zhang](https://himalayas.app/@qiangzhang): Member of Technical Staff – Foundation Models & AI Systems, OpenAI
- [Kevin Nguyen](https://himalayas.app/@kevinnguyen7): Senior Software Engineer, Google
- [Ryan Li](https://himalayas.app/@ryanli2): Senior Software Engineer, NVIDIA
- [Maxcimiliano Miranda](https://himalayas.app/@maxcimilianomiranda): Senior Software Engineer, Google
- [Austin Miller](https://himalayas.app/@austinmiller): Senior Software Engineer, Akamai Technologies
