Zhilin Xu
@zhilinxu1
Machine Learning Engineer building production-grade AI and MLOps systems.
What I'm looking for
I am a Machine Learning Engineer with deep experience architecting production-grade AI systems, low-latency anomaly detection platforms, and advanced RAG/LLM workflows. I design scalable multi-agent solutions using LangChain, LangGraph, and MCP, build high-performance ML services in Python/FastAPI, and deploy cloud-native systems on AWS and Kubernetes to deliver fault-tolerant, enterprise-ready solutions.
My background spans deep learning, computer vision, NLP, embedded inference optimization, and MLOps; I have driven measurable improvements in inference throughput, reduced release cycle times through CI/CD automation, and developed interactive visualizations for real-time diagnostics. I prioritize robust telemetry, model evaluation, and operational safety to accelerate model performance across both cloud and edge environments.
Experience
Work history, roles, and key accomplishments
Machine Learning Engineer
AppDynamics
Aug 2022 - Present (3 years 6 months)
Engineered agentic AI systems and RAG pipelines for real-time root-cause analysis, reducing diagnostic latency and delivering fault-tolerant, low-latency observability insights at enterprise scale.
AI Platform Engineer
Black Sesame Technologies Inc
Apr 2021 - Aug 2022 (1 year 4 months)
Implemented graph-optimization and INT8/FP16 quantization, designed runtime scheduling for NPU–CPU workloads under QNX RTOS, and extended toolchain importers to optimize edge inference throughput.
Software Engineer
Cornami, Inc.
May 2019 - Apr 2021 (1 year 11 months)
Designed and developed accelerator-specific ML operators and automated testing/validation pipelines to optimize model training and inference for Cornami's low-power AI chip.
Automated wafer defect matching and visualization pipelines, improving defect matching efficiency by 15% and delivering actionable insights for Surfscan systems.
Built robot communication infrastructure and cloud/Android interfaces, implemented real-time voice integration and path-planning algorithms to support multi-robot control.
Integrated Orion compare widget into Rational Team Concert code-review web app, resolved cross-stream merge discrepancies, and fixed 100+ bugs within two weeks.
Updated Android game UI and implemented matchmaking logic, contributing to a 4.5 Google Play rating for Word Streak and improving user socialization.
Software Engineer Intern
InfoMax Technologies Corporation
May 2014 - Aug 2014 (3 months)
Developed web and Android applications to register handwritten forms via digital pens, integrating device data capture with backend services.
Supported database administration tasks and data operations to maintain service reliability and support internal applications.
Contributed to software engineering projects supporting TELUS services, assisting with development and testing tasks.
Education
Degrees, certifications, and relevant coursework
University of Southern California
Master of Science, Computer Science in Data Science
2017 - 2019
Completed a Master’s degree in Computer Science with a data science focus, emphasizing machine learning, data analysis, and applied AI techniques.
University of Waterloo
Bachelor of Engineering, Computer Engineering
2012 - 2017
Earned a Bachelor’s degree in Computer Engineering with coursework and projects covering embedded systems, algorithms, and software engineering.
Tech stack
Software and tools used professionally
D3.js
Plotly.js
Microsoft Azure
Google Cloud Platform
GitHub
Kubernetes
AWS CodePipeline
Jenkins
GitHub Actions
Pandas
PostgreSQL
MongoDB
Gmail
Django
Ruby on Rails
Next.js
Tailwind CSS
Material-UI
three.js
Databricks
Redis
Terraform
Pulumi
JavaScript
Java
MATLAB
TensorFlow
PyTorch
MLflow
scikit-learn
Keras
Kafka
FastAPI
Grafana
Prometheus
OpenTelemetry
AppDynamics
Elasticsearch
OpenSearch
Zustand
Airflow
Toolkit
Root Cause
s3-lambda
CUDA
SQL
Hugging Face
LangChain
Weaviate
Shadcn/ui
Label Studio
Vite
Black
Bash
Transform
pgvector
Agentic
LangGraph
Model Context Protocol (MCP)
Dynamic
Recharts
Remote
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Zhilin?
You can contact Zhilin and 90k+ other talented remote workers on Himalayas.
Message ZhilinFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
