Skip to main content
XS
Looking for a job

Xinning Shen

@xinningshen

I build GKE AI infrastructure that puts large-scale TPU training workloads into production.

United States
Message

At Google, I lead GKE AI infrastructure across three product surfaces and guide a team of six engineers. I was the founding engineer for TPU support on Google Kubernetes Engine.

I shipped managed TPU v4, v5e, v5p, and Trillium support across tens of thousands of schedulable chips running JAX, XLA, and PyTorch/XLA workloads. I redesigned the Go node-pool lifecycle path, reducing provisioning from 18 to 6 minutes and time to first training job by 65%.

Previously, I built GKE control-plane services for a six-figure cluster fleet and reduced cluster-upgrade failures by 40%. At Amazon, I worked on exabyte-scale S3 durability and control planes, Alexa self-learning infrastructure, and Aurora database internals.

My work spans Go, Kubernetes, gRPC, cloud control planes, storage systems, and AI infrastructure. I’ve built systems that move petabytes per day, serve tens of millions of daily requests, and support production machine-learning workloads at scale.

Experience

Work history, roles, and key accomplishments

Google logoGO
Current

Staff Software Engineer - GKE AI Infrastructure Lead

May 2025 - Present (1 year 6 months)

Lead GKE AI infrastructure across three product surfaces, guiding a team of six engineers. Founding engineer for TPU support on GKE, shipping managed support for TPU v4, v5e, v5p, and Trillium across tens of thousands of schedulable chips.

GKEKubernetes
TPU V4 V5e V5p
Trillium
Jax
XLA
PyTorchGogRPC
Google logoGO

Senior Software Engineer

Nov 2022 - Apr 2025 (2 years 5 months)

Built the foundational TPU resource integration on GKE that every later accelerator generation was layered on top of. Took TPU node pools from first managed release to broad adoption across the managed Kubernetes fleet inside twelve months.

GKEKubernetes
TPU
Node Pools
GoBazel
Borg
CI CD
Google logoGO

Software Engineer - GKE Control Plane

Apr 2020 - Nov 2022 (2 years 7 months)

Developed managed control-plane services in Go over gRPC for a customer Kubernetes fleet at six-figure cluster scale. Shipped cluster orchestration and lifecycle management with Prometheus-based observability, reducing cluster-upgrade failures by 40%.

GKE
Control Plane
GogRPC
Borg
Prometheus
Amazon logoAM

Software Development Engineer - Amazon S3

Apr 2019 - Apr 2020 (1 year)

Engineered Amazon S3 storage infrastructure and control-plane systems operating at exabyte scale. Delivered a core component of an S3 storage initiative launched at AWS re:Invent 2019 on a six-month timeline.

AWSS3
Storage Infrastructure
Control Plane
Amazon logoAM

Software Development Engineer - Alexa AI & Machine Learning

Sep 2018 - Apr 2019 (7 months)

Built and launched Alexa's next-generation self-learning platform, reducing manual annotation effort by 60% across eight locales. Developed the production services behind Alexa AI and machine-learning workflows at tens of millions of daily requests.

Machine Learning Platforms
Self Learning Systems
CI CDProduction Deployment
Amazon logoAM

Software Development Engineer - RDS Aurora

Apr 2016 - Dec 2016 (8 months)

Improved the Amazon Aurora lock manager, raising write throughput 12% under high-contention workloads. Wrote the metrics and crash-investigation tooling that took database-engine root-cause time from days to hours.

BI

Software Engineer

BloomSky, Inc.

Jun 2015 - Sep 2015 (3 months)

Implemented fisheye-lens calibration, sky-region color and edge detection, and sun-track detection with OpenCV for a weather-forecasting image pipeline. Deployed a parallel cloud-cover algorithm across 500+ field devices and built an image-retrieval web application backed by RethinkDB.

OpenCVApache SparkDjango
RethinkDB
Parallel Processing

Education

Degrees, certifications, and relevant coursework

University of California, Irvine logoUI

University of California, Irvine

Master's Degree, Computer Science

2014 - 2016

Master's Degree in Computer Science from the University of California, Irvine from 2014 to 2016.

Fudan University logoFU

Fudan University

Master's Degree, Telecommunications Engineering

2011 - 2014

Master's Degree in Telecommunications Engineering from Fudan University from 2011 to 2014.

Donghua University logoDU

Donghua University

Bachelor of Engineering, Telecommunications Engineering

2007 - 2011

Bachelor of Engineering in Telecommunications Engineering from Donghua University from 2007 to 2011.

Interested in hiring Xinning?

You can contact Xinning and 600K+ other talented remote workers on Himalayas.

Message Xinning

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan