Himalayas logo
ZX
Open to opportunities

Zhilin Xu

@zhilinxu1

Machine Learning Engineer building production-grade AI and MLOps systems.

United States
Message

What I'm looking for

I seek a role building scalable, production ML/AI systems with strong MLOps, low-latency requirements, collaborative teams, and opportunities to operationalize cutting-edge LLM and edge inference solutions.

I am a Machine Learning Engineer with deep experience architecting production-grade AI systems, low-latency anomaly detection platforms, and advanced RAG/LLM workflows. I design scalable multi-agent solutions using LangChain, LangGraph, and MCP, build high-performance ML services in Python/FastAPI, and deploy cloud-native systems on AWS and Kubernetes to deliver fault-tolerant, enterprise-ready solutions.

My background spans deep learning, computer vision, NLP, embedded inference optimization, and MLOps; I have driven measurable improvements in inference throughput, reduced release cycle times through CI/CD automation, and developed interactive visualizations for real-time diagnostics. I prioritize robust telemetry, model evaluation, and operational safety to accelerate model performance across both cloud and edge environments.

Experience

Work history, roles, and key accomplishments

AppDynamics logoAP
Current

Machine Learning Engineer

AppDynamics

Aug 2022 - Present (3 years 6 months)

Engineered agentic AI systems and RAG pipelines for real-time root-cause analysis, reducing diagnostic latency and delivering fault-tolerant, low-latency observability insights at enterprise scale.

BI

AI Platform Engineer

Black Sesame Technologies Inc

Apr 2021 - Aug 2022 (1 year 4 months)

Implemented graph-optimization and INT8/FP16 quantization, designed runtime scheduling for NPU–CPU workloads under QNX RTOS, and extended toolchain importers to optimize edge inference throughput.

CI

Software Engineer

Cornami, Inc.

May 2019 - Apr 2021 (1 year 11 months)

Designed and developed accelerator-specific ML operators and automated testing/validation pipelines to optimize model training and inference for Cornami's low-power AI chip.

IBM logoIB

Software Engineer Intern

Sep 2015 - Dec 2015 (3 months)

Integrated Orion compare widget into Rational Team Concert code-review web app, resolved cross-stream merge discrepancies, and fixed 100+ bugs within two weeks.

IC

Software Engineer Intern

InfoMax Technologies Corporation

May 2014 - Aug 2014 (3 months)

Developed web and Android applications to register handwritten forms via digital pens, integrating device data capture with backend services.

Education

Degrees, certifications, and relevant coursework

University of Southern California logoUC

University of Southern California

Master of Science, Computer Science in Data Science

2017 - 2019

Completed a Master’s degree in Computer Science with a data science focus, emphasizing machine learning, data analysis, and applied AI techniques.

University of Waterloo logoUW

University of Waterloo

Bachelor of Engineering, Computer Engineering

2012 - 2017

Earned a Bachelor’s degree in Computer Engineering with coursework and projects covering embedded systems, algorithms, and software engineering.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Zhilin Xu - Machine Learning Engineer - AppDynamics | Himalayas