Peter Cai
@petercai
Senior Software Engineer specializing in Python, machine learning, and distributed data systems.
What I'm looking for
I’m a Senior Software Engineer with 8+ years of experience building scalable software systems, with a strong focus on Python, machine learning, and distributed data processing. I design end-to-end ML platforms—from datapipelines to model deployment and monitoring in production environments.
At Snap, I built a real-time content recommendation pipeline using Python, PySpark, and Kafka, and delivered low-latency ML inference services with FastAPI and TensorFlow Serving. I’ve also led feature engineering workflows with Airflow and improved reliability by implementing drift monitoring with Prometheus and Grafana.
Earlier at TikTok and Bloomberg LP, I shipped backend systems that combine robust data processing, efficient APIs, and production-grade observability. I enjoy solving complex, high-scale problems using modern cloud and backend technologies, and I actively guide engineers to raise code quality, testing standards, and deployment practices.
Experience
Work history, roles, and key accomplishments
Built a real-time content recommendation pipeline using Python, PySpark, and Kafka, implementing partitioned event streams and fault-tolerant consumers to prevent data loss under peak traffic. Developed low-latency ML inference services with FastAPI and TensorFlow Serving and engineered feature pipelines with Airflow plus drift monitoring with Prometheus/Grafana.
Built a personalized recommendation backend using Python (Django) and Java (Spring Boot), addressing ranking/serving consistency with shared feature contracts and validation checks. Developed LLM-powered content moderation with Hugging Face Transformers and PyTorch, and designed asynchronous processing, Feast-based feature storage, model experimentation, and end-to-end observability with OpenTelem
Built financial data aggregation services using Python and Flask with normalization layers and validation rules for real-time feeds. Implemented streaming pipelines with Apache Flink and optimized PostgreSQL schemas, while creating reconciliation tools to detect and resolve discrepancies across data providers.
Built a recommendation prototype using Python and NumPy, experimenting with hybrid approaches to address cold-start issues. Designed relational data models in MySQL, created front-end visualizations with HTML/CSS/JavaScript, and improved experimental reliability with unit/integration tests.
Built React and Bootstrap interfaces to display ML experiment results for internal users and created Python scripts to preprocess datasets with missing/inconsistent data handling. Developed REST APIs with Node.js (Express), set up scikit-learn evaluation pipelines, and added automated testing with Jest and Mocha.
Education
Degrees, certifications, and relevant coursework
University of California, Santa Cruz
Master’s Degree - Computer Science, Computer Science
2019 - 2021
Completed a Master’s Degree in Computer Science at the University of California, Santa Cruz from 2019 to 2021.
Beijing University of Posts and Telecommunications
Bachelor’s Degree - Computer Science, Computer Science
2015 - 2019
Earned a Bachelor’s Degree in Computer Science at Beijing University of Posts and Telecommunications from 2015 to 2019.
Tech stack
Software and tools used professionally
Google Tag Manager
Apache Spark
Apache Flink
Google Cloud Platform
GitHub
Kubernetes
Cloudflare
Jenkins
GitHub Actions
NumPy
Pandas
PySpark
MySQL
PostgreSQL
Node.js
Django
Spring Boot
Dropwizard
Google Analytics
Redis
Terraform
Mocha
React
JavaScript
Python
HTML5
Java
CSS 3
Logstash
TensorFlow
PyTorch
scikit-learn
Kafka
FastAPI
asyncio
Grafana
Kibana
Prometheus
OpenTelemetry
GraphQL
gRPC
Elasticsearch
TypeScript
pytest
Docker
Airflow
Apache Beam
SQL
XGBoost
SciPy
Hugging Face
LightGBM
Pydantic
Feast
Great Expectations
Bash
Transform
Keep
Factory
Beam
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Peter?
You can contact Peter and 90k+ other talented remote workers on Himalayas.
Message PeterFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
