HimalayasHimalayas logo
Shyft6SH

Quality Engineering & AI Validation Manager

Shyft6
United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

This is a remote position.

Quality Engineering & AI Validation Manager

Reporting to Head of Engineering, leads Accordion's centralized Quality Engineering and AI Validation function across software delivery pods. Owns the quality operating model, release-readiness standards, test strategy, AI validation framework, and quality metrics used to support both conventional software and AI-enabled solutions. Ensures quality is designed into delivery from the start, not inspected in at the end.

Key Responsibilities

Quality Strategy & Governance

  • Define the firm-wide quality strategy, release gates, and validation standards across development pods.
  • Establish a risk-based quality model for traditional software and AI-enabled workflows.
  • Define when pod-level validation is sufficient and when independent QA validation is required.

AI Validation Leadership

  • Build and operationalize the QA approach for AI-led products, including benchmark datasets, scoring rubrics, regression comparisons, and grounded-output validation.
  • Establish testing expectations for instruction adherence, consistency, business correctness, control compliance, and hallucination risk.
  • Partner with Engineering and Product leaders on quality implications of prompt, model, workflow, and tooling changes.

Team Leadership

  • Lead and develop quality engineers, AI quality analysts, and domain-oriented QA resources.
  • Improve the maturity of automation, evaluation routines, test evidence standards, and release discipline.
  • Create a scalable central model that supports pods without becoming a bottleneck.

Finance & Risk Alignment

  • Partner with Finance and practice SMEs to ensure solutions are validated against real business use, materiality, and control expectations.
  • Ensure high-risk workflows receive the right level of domain review before production release.

Production Quality

  • Define the framework for production quality monitoring, including escaped defects, output-quality degradation, reviewer overrides, and control failures.
  • Create visibility into quality trends, readiness, and recurring failure patterns for Engineering and leadership.

Requirements

Required Qualifications
  • 8+ years of QA, software testing, or quality engineering experience, including team leadership.
  • Experience building test strategy, release-readiness processes, and automation programs in modern software environments.
  • Experience supporting AI-enabled applications, workflow automation, data products, or decision-support systems.
  • Strong understanding of functional, integration, regression, API, and data validation approaches.
  • Ability to translate business-critical finance workflows into quality controls and release criteria.
  • Strong communication skills and credibility with Engineering, Product, and business stakeholders.

·Bachelor's degree preferred.

You Are
  • Structured, pragmatic, and highly credible.
  • Comfortable asking tough questions about readiness, risk, and evidence.
  • A builder of quality systems and operating models.
  • Fluent in both engineering quality and business impact.
  • Focused on trust, traceability, and scalable execution.

Benefits

Salary plus a performance-based bonus
Actual compensation packages are determined by evaluating a wide array of factors unique to each candidate, including but not limited to skill set, years and depth of experience, education, certifications, cost of labor, and internal equity.

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Experience

8 years minimum

Location requirements

Hiring timezones

United States +/- 0 hours
Claim this profileShyft6 logoSH

Shyft6

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

26 remote jobs at Shyft6

Explore the variety of open remote roles at Shyft6, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Shyft6

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan