Skip to main content
Nancy PowerNP
Open to opportunities

Nancy Power

@nancypower

AI Data Trainer | Audio & Multimodal Evaluation Specialist | RLHF & QA | JSON & Prompt Evaluation

Canada
Message

What I'm looking for

I’m seeking a role that leverages my analytical thinking, attention to detail, and interest in data-driven decision-making. I’m particularly drawn to positions that involve evaluation, process improvement, or supporting evidence-based initiatives.

AI-focused quality evaluator and workflow specialist with 15+ years of experience spanning AI model evaluation, multimodal annotation, audio

analysis, operational support, and enterprise-style QA. Experienced in designing and testing long-horizon AI evaluation tasks, reviewing

model outputs, validating instruction adherence, identifying failure patterns, and translating complex findings into stakeholder-ready feedback.

Strong background across text, audio, image, video, structured data, JSON-based workflows, RLHF, prompt evaluation, and business

process simulations.

Experience

Work history, roles, and key accomplishments

FL
Current

AI Workflow Evaluation & QA Specialist

Fleet

Jan 2025 - Present (1 year 5 months)

Designed, tested, and refined AI evaluation tasks that measure how well AI agents complete realistic enterprise workflows across multiple applications and dependent data sources. Performed deep functional QA using workflow traces and prompt tests, then communicated risks and improvement opportunities to stakeholders.

MI
Current

Audio Annotator & Voice Evaluator

Micro1

Jan 2025 - Present (1 year 5 months)

Analyzed speech and environmental audio to support AI training for speech and audio understanding, including tone, cadence, pronunciation, and speaker characteristics. Applied structured labeling and reviewed data quality, clarity, relevance, and compliance with project standards.

ME
Current

AI trainor

Mercor

Aug 2025 - Present (10 months)

Performed daily preference ranking of multimodal AI outputs to evaluate model performance. Applied comparative judgment to assess relevance, quality, and coherence of generative outputs. Delivered high-accuracy annotations supporting reinforcement learning and fine-tuning, improving model alignment and benchmark consistency.

Education

Degrees, certifications, and relevant coursework

DC

Durham College

Diploma, Advertising

Completed a program focused on advertising principles and practices. Gained knowledge in marketing strategies, media planning, and campaign development.

SC

Seneca College

Certificate, Cosmetic Techniques and Management

Studied cosmetic techniques and management, acquiring skills in beauty industry practices and business operations. Developed expertise in product knowledge and client relations.

Find your dream job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan