ZoomInfoZO

Senior Machine Learning Engineer – MLOps & LLMOps

ZoomInfo is a premier go-to-market intelligence provider, equipping businesses with essential data and insights for effective sales and marketing.

ZoomInfo

Salary: 180k-248k USD

United States only

At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We value your take charge, take initiative, get stuff done attitude and will help you unlock your growth potential. One great choice can change everything. Thrive with us at ZoomInfo.

At ZoomInfo we turn billions of data points into instant go-to-market answers for 40,000+ customers. To keep that edge, we’re building an elite Applied AI platform that scales from first experiment to planet-scale production—securely, cost-effectively, and fast. Join us as a Senior Machine Learning Engineer and own the MLOps & LLMOps backbone that powers our retrieval, recommendation, and knowledge-graph products.

What you will do:

  • Architect the end-to-end MLOps / LLMOps stack (Kubernetes, Ray, Argo, Terraform, MLFlow, Feature & Model Stores) for training, fine-tuning, and serving LLMs, RAG pipelines, NER, and entity-resolution models at multi-billion-record scale.
  • Design cost-aware training & inference workflows—automatic mixed precision, quantization, distillation, dynamic batching, on-demand GPU/CPU autoscaling—to cut $/call and CO₂ while meeting 99.9% SLAs.
  • Build iron-clad evaluation & safety frameworks: red-teaming, hallucination scoring, PII/toxicity filters, guardrail policies, shadow deployments, and continuous regression tests.
  • Fine-tune embedding models and pre-train domain-specific LLMs on ZoomInfo corpora; integrate with vector databases (Pinecone, Milvus, OpenSearch) to power RAG search and recommender systems.
  • Prototype and benchmark emerging AI/infra tech (parameter-efficient tuning, retrieval frameworks, serverless GPUs) against incumbent solutions; present clear “buy-build-borrow” recommendations.
  • Model, build, and optimize knowledge graphs—schema design, entity linking, incremental updates—to supercharge retrieval and recommendation accuracy.
  • Profile and re-architect RAG, NER, and entity-resolution services for sub-100 ms latency, 5× QPS jumps, and zero-downtime deploys across global regions.
  • Lead multi-team CI/CD best practices—blue/green, canary, GitOps—and large-scale A/B tests to quantify revenue impact.
  • Mentor engineers, publish internal playbooks & external blogs, and speak at industry forums to cement ZoomInfo’s technical leadership.

What you bring:

  • 7+ years building production ML systems (or 4+ post-PhD/MS) with at least two at 100M+ user or record scale.
  • Deep expertise in modern MLOps/LLMOps (K8s, Docker, MLFlow/Vertex AI/SageMaker, Kubeflow, Airflow, ArgoCD, model registries).
  • Proven record optimizing LLMs/SLMs via quantization, LoRA/PEFT, distillation, and distributed training (DeepSpeed, FSDP, Hugging Face, TensorRT-LLM).
  • Strong software-engineering fundamentals in Python and experience with distributed computing infrastructure such as Spark and Ray based jobs and pipelines
  • Hands-on mastery of vector search & RAG patterns, entity-resolution algorithms, and graph data stores (Neo4j, Neptune, JanusGraph, Spanner Graph) is a major plus.
  • Fluency in cost, reliability, security, and compliance trade-offs; comfortable providing inputs to budgets and setting SLOs.
  • Exceptional communication skills—able to align executives, PMs, Data Scientists and engineers around data-driven decisions.

Why ZoomInfo?

  • Own infrastructure that touches billions of documents, millions of daily requests, and nine-figure revenue lines.
  • Green-field influence: choose the stack, set the guardrails, and define best practices that shape our next-gen AI platform.
  • Culture that rewards initiative, collaboration, ships quickly, invests heavily in professional growth.
  • Competitive pay, equity, and benefits; flexible location (US hubs, or remote within US and Canada. Candidate needs to be living in the USA or Canada).

Ready to industrialize AI at scale? Apply now and build the backbone of ZoomInfo’s next era of intelligent products.

Actual compensation offered will be based on factors such as the candidate’s work location, qualifications, skills, experience and/or training. Your recruiter can share more information about the specific salary range for your desired work location during the hiring process. We want our employees and their families to thrive.

In addition to comprehensive benefits we offer holistic mind, body and lifestyle programs designed for overall well-being. Learn more about ZoomInfo benefits here.

Below is the US base salary for this position. Additional compensation such as Bonus, Commission, Equity and other benefits may also apply.$180,000—$247,500 USD

About us:

ZoomInfo (NASDAQ: ZI) is the Go-To-Market Intelligence Platform that empowers businesses to grow faster with AI-ready insights, trusted data, and advanced automation. Its solutions provide more than 35,000 companies worldwide with a complete view of their customers, making every seller their best seller.

ZoomInfo may use a software-based assessment as part of the recruitment process. More information about this tool, including the results of the most recent bias audit, is available here.

ZoomInfo is proud to be an equal opportunity employer, hiring based on qualifications, merit, and business needs, and does not discriminate based on protected status. We welcome all applicants and are committed to providing equal employment opportunities regardless of sex, race, age, color, national origin, sexual orientation, gender identity, marital status, disability status, religion, protected military or veteran status, medical condition, or any other characteristic protected by applicable law. We also consider qualified candidates with criminal histories in accordance with legal requirements.

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Senior

Salary

Salary: 180k-248k USD

Location requirements

Hiring timezones

United States +/- 0 hours

About ZoomInfo

Learn more about ZoomInfo and their company culture.

View company profile

ZoomInfo is a leading provider of go-to-market intelligence solutions for sales and marketing teams. Through its cloud-based platform, it enables businesses to access comprehensive data and insights about companies and professionals. Leveraging artificial intelligence and machine learning, ZoomInfo delivers actionable intelligence that helps teams refine their outreach strategies, optimize their marketing efficiency, and ultimately increase sales productivity.

The platform offers various functionalities including advanced search capabilities, company and contact data, and market research tools. It is designed to empower organizations to identify their ideal customers and develop targeted outreach strategies that resonate with their audience. By utilizing real-time data, businesses can make informed decisions to drive their growth and stay ahead of the competition. ZoomInfo’s commitment to data quality ensures that its users have access to accurate, updated, and relevant information for their go-to-market efforts.

Claim this profileZoomInfo logoZO

ZoomInfo

Employees live in

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

14 remote jobs at ZoomInfo

Explore the variety of open remote roles at ZoomInfo, offering flexible work options across multiple disciplines and skill levels.

View all jobs at ZoomInfo

Remote companies like ZoomInfo

Find your next opportunity by exploring profiles of companies that are similar to ZoomInfo. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
ZoomInfo hiring Senior Machine Learning Engineer – MLOps & LLMOps • Remote (Work from Home) | Himalayas