# Jared Teraoka

Jared Teraoka is a remote worker on Himalayas, Senior AI/ML Engineer at Zoom, based in United States.

Source: https://himalayas.app/@jaredteraoka

```text
Senior AI/ML and Full Stack Engineer delivering scalable LLM orchestration and production ML systems.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Job categories | Senior ML Engineer, Senior ML Engineer, AI ML Engineer, Full Stack Engineer, Backend Engineer, Machine Learning Infrastructure Engineer, Applied Machine Learning Engineer, Data Engineer, DevOps Engineer, Research Engineer, Senior AI Engineer, Senior AI ML Operations Engineer, Senior ML Platform Engineer, Sr. Staff AI Engineer, Senior AI LLM Engineer, Senior Full Stack AI Engineer |
| Skills | Python, JavaScript, Go, SQL, TypeScript, BASH, Shell Scripting, Lang Chain, PyTorch, ONNX Runtime, Transformers, Hugging Face, DistilBERT, scikit learn, TensorFlow, Pandas, NumPy, Large Language Models, Claude Sonnet 3.5, GPT 4, OpenAI API, Prompt Engineering, Model Fine Tuning, Pinecone, Faiss, OpenSearch, Elasticsearch, Semantic Search, Embeddings, Vector Similarity, AWS, AWS Lambda, AWS Sagemaker, Amazon EKS, NVIDIA Triton Inference Server, Docker, S3, RAG, CSS, Cloudwatch, Kubernetes, Microservices Architecture, gRPC, REST APIs, ETL, Real Time Streaming Data, React, HTML5, Responsive Design, PostgreSQL, MongoDB, Redis, CI CD, Git, Prometheus, Grafana, Performance Optimization, ES6, fastAPI, Kafka, NodeJS |

## What I'm looking for

```text
I seek roles building production AI/ML systems and LLM orchestration at scale, with strong engineering ownership, cloud-native tooling, and opportunities to impact product outcomes.
```

## About

```text
I am a Senior AI/ML and Full Stack Engineer with 6+ years building production AI systems at Zoom and eBay, focusing on LLM orchestration, Retrieval-Augmented Generation, and scalable ML pipelines. I have led deployment of model serving infrastructure, vector databases, and microservices to deliver sub-second responses and measurable product impact.

My background spans full stack development with React front-ends and Python/Node.js back-ends, cloud-native infrastructure on AWS, and ML tooling including LangChain, PyTorch, ONNX, and Triton. I consistently drive improvements through A/B testing, prompt optimization, and performant data pipelines that scale to millions of users.
```

## Experience

### Senior AI/ML Engineer

[Zoom](https://himalayas.app/companies/zoom-video-communications). Jun 2022 - Sep 2025

```text
Architected AI orchestration pipelines and RAG systems for Zoom AI Companion, enabling sub-second meeting summaries and action item extraction for 100M+ monthly users and optimizing model routing for cost and latency.
```

Skills: Pinecone, fastAPI, Sagemaker, RAG, gRPC, Prompt-Engineering

### Backend Engineer, AI Integration

[eBay](https://himalayas.app/companies/ebay-inc). May 2020 - May 2022

```text
Integrated DistilBERT and ONNX-based models into Ads Recommendations, improving CTR for long-tail queries and building data pipelines and FAISS vector search for experimentation infrastructure.
```

Skills: Python, ONNX-Runtime, PyTorch, Faiss, Kafka, Go, Docker, Kubernetes, gRPC

### Full Stack Engineer

[eBay](https://himalayas.app/companies/ebay-inc). Sep 2018 - May 2020

```text
Built developer tools and dashboards using React and Python Flask to streamline Ads Recommendations workflows and implemented front-end components with ML-driven campaign management features.
```

Skills: React, JavaScript, Python, Flask, REST-APIs, SQL, Frontend-Development

### Software Engineer Intern

[American Family Insurance](https://himalayas.app/companies/american-family-insurance). Feb 2018 - Aug 2018

```text
Developed Python automation and data validation scripts that reduced manual claims data entry by 40% and improved policy database quality for actuarial reporting.
```

Skills: Python, Pandas, NumPy, Data-Validation, ETL, Automation, Data-Quality, Scripting

## Education

### University of Wisconsin, Madison

Bachelor of Science, Computer Science. 2014 - 2018

```text
Completed a Bachelor of Science in Computer Science focusing on software engineering and data processing from Aug 2014 to May 2018.
```

## Tech stack

- Kubernetes
- NumPy
- Pandas
- PostgreSQL
- MongoDB
- Gmail
- Node.js
- Redis
- JavaScript
- HTML5
- ES6
- TensorFlow
- PyTorch
- scikit-learn
- Kafka
- FastAPI
- Grafana
- Prometheus
- gRPC
- Elasticsearch
- OpenSearch
- AWS Lambda
- Amazon Web Services (AWS)
- SQL
- Hugging Face
- LangChain
- Pinecone
- OpenAI API
- NVIDIA Triton Inference Server
- ONNX Runtime
- Bash

To contact Jared, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Robert Erikson](https://himalayas.app/@roberterikson): Senior ML Engineer – AI Systems, BlueLabel
- [Bhavishya Mittal](https://himalayas.app/@bhavishyamittal): Senior AI/ML Engineer, Orby AI
- [Samuel Evans](https://himalayas.app/@samuelevans2): Senior AI & Full Stack Engineer, Jump AI
- [Corey Fleming](https://himalayas.app/@coreyfleming): Senior AI / ML Engineer, Ubersuggest
- [Stephen Chen](https://himalayas.app/@stephenchen): Senior AI Engineer, Adept
- [Sujanesh Jasti Jasti](https://himalayas.app/@sujaneshjastijasti): Senior Software Engineer, Mattress Firm
- [Matthew Schmidt](https://himalayas.app/@matthewschmidt): Senior AI/ML Engineer, Camunda
- [Jared Haneytang](https://himalayas.app/@jaredhaneytang): Senior AI Engineer, Zoom
- [Michael Zhu](https://himalayas.app/@michaelzhu): Senior Software Engineer, Alluxii
- [Rohan Iyengar](https://himalayas.app/@rohaniyengar): Senior AI / ML Engineer, Notable Healthcare
