Zhilin Xu
@zhilinxu
AI/ML engineer building production-grade, hardware‑efficient AI systems.
What I'm looking for
I am an AI/ML engineer with 7+ years designing high-performance, production-grade AI systems across cloud, embedded, and enterprise platforms. I specialize in model optimization, quantization, mixed-precision training, and hardware-aware acceleration to deliver measurable latency and cost improvements.
I have built agentic orchestration frameworks, AI-as-a-Service infrastructures, and RCA pipelines integrating LLM reasoning, telemetry, and vectorized knowledge graphs for enterprise observability. At AppDynamics I led an AI-Assisted Root-Cause-Analysis initiative and deployed multi-agent reasoning and telemetry-driven inference on Kubernetes and AWS.
My work spans embedded SoC optimization, compiler and kernel collaboration, and MLOps best practices—enabling seamless deployment from research to production. I am passionate about bridging AI research and systems engineering to create reliable, interpretable, and high-throughput AI solutions that drive real-world business impact.
Experience
Work history, roles, and key accomplishments
Machine Learning Engineer
AppDynamics
Aug 2022 - Jun 2025 (2 years 10 months)
Led development of an AI-assisted Root-Cause-Analysis system integrated into AppDynamics' AIOps platform, reducing RCA latency by 40% and enabling cross-product observability automation via AI-as-a-Service APIs.
Senior Full Stack Engineer
Black Sesame Technologies
Apr 2021 - Aug 2022 (1 year 4 months)
Developed an AI model quantization framework and evaluation pipeline for automotive SoCs, improving inference throughput and reducing latency by ~30% through mixed-precision and backend optimizations.
Backend Developer
Cornami
May 2019 - Apr 2021 (1 year 11 months)
Designed hardware-aware ML operator libraries and dataflow optimizations for a low-power AI chip, enabling high-throughput inference and demonstrating superior performance-per-watt on transformer workloads.
Education
Degrees, certifications, and relevant coursework
University of Southern California
Master of Science, Computer Science
2017 - 2019
Grade: 3.6
Completed a Master of Science in Computer Science with coursework and projects focused on AI, machine learning, and systems engineering.
University of Waterloo
Bachelor of Computer Science, Computer Science
2012 - 2017
Grade: 3.3
Earned a Bachelor of Computer Science with emphasis on software engineering and systems relevant to machine learning and high-performance computing.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Zhilin?
You can contact Zhilin and 90k+ other talented remote workers on Himalayas.
Message ZhilinFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
