Open to opportunities

Xin Zhang

@xinzhang1

Message

Senior AI engineer specializing in LLM, RAG, and scalable production AI infrastructure.

United States

Message

What I'm looking for

I want to build production LLM and RAG systems—optimized for low latency, cost, and reliability—working end-to-end from design to deployment with strong MLOps and distributed training.

I’m a Senior AI Engineer with 10+ years of experience building LLM, Generative AI, RAG, recommendation systems, and cloud-native ML platforms. I focus on distributed training, model optimization, AI infrastructure, and NLP, with scalable backends that deliver production AI supporting millions of users.

At Apple, I developed AI-powered cloud services for large-scale products, built LLM applications and RAG pipelines using enterprise knowledge bases, and optimized distributed AI services for low latency and high availability. I also improved LLM inference performance through GPU acceleration and model optimization, delivering AI infrastructure serving millions of daily requests and leading features from design to production.

Previously at Oracle, I built deep learning recommendation systems improving CTR by 22%, and developed NLP document intelligence and semantic search pipelines. I deployed distributed Spark training pipelines with feature stores and MLOps workflows, and reduced model deployment time from weeks to hours through CI/CD automation, while earlier roles covered fraud detection, predictive analytics, and ML APIs on containerized cloud infrastructure.

Experience

Work history, roles, and key accomplishments

Senior AI Engineer

Apple

Apr 2024 - Apr 2026 (2 years)

Developed AI-powered cloud services for large-scale Apple products, building LLM applications and RAG pipelines using enterprise knowledge bases. Optimized distributed AI services for low latency and high availability and improved inference performance via GPU acceleration and model optimization.

LLM Applications High Availability GPU Acceleration Optimization AI Infrastructure

Senior Machine Learning Engineer

Oracle

Jan 2022 - Jan 2024 (2 years)

Built deep learning recommendation systems and improved CTR by 22%. Developed NLP document intelligence and semantic search pipelines, and deployed distributed Spark training pipelines with feature stores and MLOps workflows.

Deep Learning Recommendation Systems CTR NLP Document Intelligence Semantic Search MLOps CI CD Automation

Machine Learning Engineer

Oracle NetSuite

Jan 2018 - Jan 2021 (3 years)

Developed fraud detection and predictive analytics for enterprise SaaS, including building ML features for ERP finance and transaction analytics. Improved real-time anomaly detection and engineered features for large-scale datasets, and built ML APIs for containerized cloud deployments.

Fraud Detection Predictive Analytics ERP Finance Anomaly Detection Feature Engineering Feature Engineering Infrastructure Cloud Infrastructure

Software Engineer

IBM

Jan 2018 - Jan 2021 (3 years)

Developed Java/Python microservices on Kubernetes and built ML models and REST APIs for enterprise analytics. Optimized backend performance using caching and database systems, and productionized ML models using Agile and DevOps practices.