Himalayas logo
Zhilin XuZX
Open to opportunities

Zhilin Xu

@zhilinxu

AI/ML engineer building production-grade, hardware‑efficient AI systems.

United States
Message

What I'm looking for

I seek roles building scalable, production AI infrastructure—focusing on model optimization, MLOps, and hardware‑efficient inference in collaborative, engineering-driven teams.

I am an AI/ML engineer with 7+ years designing high-performance, production-grade AI systems across cloud, embedded, and enterprise platforms. I specialize in model optimization, quantization, mixed-precision training, and hardware-aware acceleration to deliver measurable latency and cost improvements.

I have built agentic orchestration frameworks, AI-as-a-Service infrastructures, and RCA pipelines integrating LLM reasoning, telemetry, and vectorized knowledge graphs for enterprise observability. At AppDynamics I led an AI-Assisted Root-Cause-Analysis initiative and deployed multi-agent reasoning and telemetry-driven inference on Kubernetes and AWS.

My work spans embedded SoC optimization, compiler and kernel collaboration, and MLOps best practices—enabling seamless deployment from research to production. I am passionate about bridging AI research and systems engineering to create reliable, interpretable, and high-throughput AI solutions that drive real-world business impact.

Experience

Work history, roles, and key accomplishments

AppDynamics logoAP

Machine Learning Engineer

AppDynamics

Aug 2022 - Jun 2025 (2 years 10 months)

Led development of an AI-assisted Root-Cause-Analysis system integrated into AppDynamics' AIOps platform, reducing RCA latency by 40% and enabling cross-product observability automation via AI-as-a-Service APIs.

BT

Senior Full Stack Engineer

Black Sesame Technologies

Apr 2021 - Aug 2022 (1 year 4 months)

Developed an AI model quantization framework and evaluation pipeline for automotive SoCs, improving inference throughput and reducing latency by ~30% through mixed-precision and backend optimizations.

CO

Backend Developer

Cornami

May 2019 - Apr 2021 (1 year 11 months)

Designed hardware-aware ML operator libraries and dataflow optimizations for a low-power AI chip, enabling high-throughput inference and demonstrating superior performance-per-watt on transformer workloads.

Education

Degrees, certifications, and relevant coursework

University of Southern California logoUC

University of Southern California

Master of Science, Computer Science

2017 - 2019

Grade: 3.6

Completed a Master of Science in Computer Science with coursework and projects focused on AI, machine learning, and systems engineering.

University of Waterloo logoUW

University of Waterloo

Bachelor of Computer Science, Computer Science

2012 - 2017

Grade: 3.3

Earned a Bachelor of Computer Science with emphasis on software engineering and systems relevant to machine learning and high-performance computing.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Zhilin Xu - Machine Learning Engineer - AppDynamics | Himalayas