Zhilin Xu
@zhilinxu
AI/ML engineer building production-grade, hardware‑efficient AI systems.
What I'm looking for
I am an AI/ML engineer with 7+ years designing high-performance, production-grade AI systems across cloud, embedded, and enterprise platforms. I specialize in model optimization, quantization, mixed-precision training, and hardware-aware acceleration to deliver measurable latency and cost improvements.
I have built agentic orchestration frameworks, AI-as-a-Service infrastructures, and RCA pipelines integrating LLM reasoning, telemetry, and vectorized knowledge graphs for enterprise observability. At AppDynamics I led an AI-Assisted Root-Cause-Analysis initiative and deployed multi-agent reasoning and telemetry-driven inference on Kubernetes and AWS.
My work spans embedded SoC optimization, compiler and kernel collaboration, and MLOps best practices—enabling seamless deployment from research to production. I am passionate about bridging AI research and systems engineering to create reliable, interpretable, and high-throughput AI solutions that drive real-world business impact.
Experience
Work history, roles, and key accomplishments
Machine Learning Engineer
AppDynamics
Aug 2022 - Jun 2025 (2 years 10 months)
Led development of an AI-assisted Root-Cause-Analysis system integrated into AppDynamics' AIOps platform, reducing RCA latency by 40% and enabling cross-product observability automation via AI-as-a-Service APIs.
Senior Full Stack Engineer
Black Sesame Technologies
Apr 2021 - Aug 2022 (1 year 4 months)
Developed an AI model quantization framework and evaluation pipeline for automotive SoCs, improving inference throughput and reducing latency by ~30% through mixed-precision and backend optimizations.
Backend Developer
Cornami
May 2019 - Apr 2021 (1 year 11 months)
Designed hardware-aware ML operator libraries and dataflow optimizations for a low-power AI chip, enabling high-throughput inference and demonstrating superior performance-per-watt on transformer workloads.
Education
Degrees, certifications, and relevant coursework
University of Southern California
Master of Science, Computer Science
2017 - 2019
Grade: 3.6
Completed a Master of Science in Computer Science with coursework and projects focused on AI, machine learning, and systems engineering.
University of Waterloo
Bachelor of Computer Science, Computer Science
2012 - 2017
Grade: 3.3
Earned a Bachelor of Computer Science with emphasis on software engineering and systems relevant to machine learning and high-performance computing.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Zhilin?
You can contact Zhilin and 90k+ other talented remote workers on Himalayas.
Message ZhilinFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
