Model Evaluation QA Lead

Save

Powering insight-driven decisions and growth with world-leading speech recognition for businesses.

Deepgram

Employee count: 51-200

United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

As Model Evaluation QA Lead, you'll be responsible for ensuring model quality assurance across Deepgram's AI pipeline. You'll design automated evaluation frameworks, integrate model quality gates into release pipelines, and drive industry-standard benchmarking.

Requirements

4–7 years of experience in QA engineering, ML evaluation, or a related technical role
Hands-on experience building automated test/evaluation pipelines for ML models
Strong programming skills in Python
Familiarity with speech/audio ML concepts
Experience with CI/CD integration for ML workflows

Benefits

Medical, dental, vision benefits
Annual wellness stipend
Mental health support
Life, STD, LTD Income Insurance Plans
Unlimited PTO
Generous paid parental leave
Flexible schedule
12 Paid US company holidays
Quarterly personal productivity stipend
One-time stipend for home office upgrades
401(k) plan with company match
Tax Savings Programs

Apply now

Please let Deepgram know you found this job on Himalayas. This helps us grow!

Apply now

About the job

Apply before

Apr 11, 2026

Posted on

Feb 10, 2026

Job type

Full Time

Experience level

Mid-level

Location requirements

United States

Hiring timezones

United States +/- 0 hours

Job categories

Quantitative Modeling QA Lead Senior Quantitative QA Engineer Senior AI Analytics Engineer Data Quality Engineer Jobs

Skills

Python QA Engineering AI model evaluation CI CD Quality Assurance Automated Pipeline Engineering Deepgram

About Deepgram

Learn more about Deepgram and their company culture.

View company profile

Powering insight-driven decisions and growth with world-leading speech recognition for businesses.

In 2015, influenced by their backgrounds in particle physics, founders Dr. Scott Stephenson and Noah Shutty used Applied AI techniques to search and find specific moments buried within large amounts of recorded audio. After building a speech analysis platform unlike anything currently available in commercial markets, they set out to build the speech company for the future.

Since being backed by YCombinator — an incubator that’s invested in companies like Airbnb, Dropbox, and Stripe — Deepgram, with its team of PhDs, engineers, and world-class AI scientists, released the world’s first deep learning based speech recognition in Fall 2017. Deepgram has since developed Dedicated Speech Models to bring companies unparalleled gains in accuracy and speech understanding capabilities in addition to being backed by NVIDIA and signing key enterprise customers.

Tech stack

Learn about the tools and technologies that Deepgram uses to build, market, and sell its products.

View tech stack

Bootstrap

JavaScript

Python

HTML5

CSS 3

Stripe Billing

Salesforce

Intercom

Heap

Google Analytics

Mixpanel

6 more

Deepgram employees can create an account to update this tech stack.

Employee benefits

Learn about the employee benefits and perks provided at Deepgram.

View benefits

Healthy meals and snacks

Enjoy healthy meals and lunch on us in offices.

Healthcare benefits

Medical, dental, and vision insurance for employees and dependents.

Unlimited time off

Take as much time off as you want as long as it doesn't interfere with your ability to do your work.

Work from home ergonomic stipend

Since you work remotely, we want to make sure your home office is comfortable. You can expense to furnish your home office, every three years.

View Deepgram's employee benefits

Apply now

Please let Deepgram know you found this job on Himalayas. This helps us grow!

Apply now

About the job

Apply before

Apr 11, 2026

Posted on

Feb 10, 2026

Job type

Full Time

Experience level

Mid-level

Location requirements

United States

Hiring timezones

United States +/- 0 hours

Job categories

Quantitative Modeling QA Lead Senior Quantitative QA Engineer Senior AI Analytics Engineer Data Quality Engineer Jobs

Skills

Python QA Engineering AI model evaluation CI CD Quality Assurance Automated Pipeline Engineering Deepgram

Claim this profile

Deepgram

Company size

51-200 employees

Founded in

2015

Markets

Speech Recognition Deep Learning Developer APIs Speech Analytics

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

AL, AR + 38 more

Software Engineer, AI (Python)

G2i

Employee count: 11-50

Salary: 62k-146k USD

Full Time

Python AI Engineer

United States only

Machine Learning Engineer

Adapter

Salary: 180k-225k USD

Full Time

Engineering

United States only

Machine Learning Engineer

LMArena

Full Time

Machine Learning Engineer

United States only

AI Engineer

continued

Employee count: 51-200

Full Time

AI Engineer

United States only

AI QA Engineer – Senior

Spektra Systems

Employee count: 201-500

Full Time

Senior QA Engineer

United States only

Senior or Principal Quality Software Engineer

Dropzone AI

Employee count: 11-50

Salary: 180k-225k USD

13 remote jobs at Deepgram

Explore the variety of open remote roles at Deepgram, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Deepgram

United States only

Revenue Operations Analyst

Deepgram

Employee count: 51-200

Full Time

Revenue Operations Analyst

United States only

Enterprise Account Executive, Deepgram for Restaurants

Deepgram

Employee count: 51-200

Full Time

United Kingdom only

Sales Development Representative (London)

Deepgram

Employee count: 51-200

Full Time

Sales Development Representative

AU, JP + 3 more

Customer Success Engineer (APAC)

Deepgram

Employee count: 51-200

Full Time

Customer Success Engineer

United States only

Marketing Lead, Deepgram for Restaurants

Deepgram

Employee count: 51-200

Full Time

Marketing Lead

United States only

Software Engineer - Deepgram for Restaurants

Deepgram

Employee count: 51-200

Full Time

Software Engineer Jobs

Top remote companies

Remote companies like Deepgram

Find your next opportunity by exploring profiles of companies that are similar to Deepgram. Compare culture, benefits, and job openings on Himalayas.

View all companies

Prodigal

Benefits Tech stack

Based in Silicon Valley, Prodigal is bringing the power of AI and machine learning to lenders, creditors, and collection agencies.

Artificial Intelligence Machine Learning

SafeGraph

Benefits Tech stack

SafeGraph is a data company. That's it - that's all we do.

Big Data Data Mining

BrightHire

Benefits Tech stack

BrightHire is performance optimization technology for recruiting teams.

Speech Recognition Talent Analytics

Deepnote

Benefits Tech stack

We started Deepnote with a simple mission: to solve the most difficult data science problems.

SaaS Cloud Infrastructure

CL8 jobs

Clarifai

Salaries Benefits Tech stack

Clarifai is an artificial intelligence company that excels at visual recognition.

Artificial Intelligence Neural Networks

AS3 jobs

AssemblyAI

Salaries Benefits Tech stack

AssemblyAI is a remote-first AI company building powerful deep learning models for developers, startups, and enterprises to transcribe and understand their audio data.

Developer APIs Developer Tools

Top remote companies

Remote companies like Deepgram

Find your next opportunity by exploring profiles of companies that are similar to Deepgram. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!