Open to opportunities

Nancy Chebet

@nancychebet

Message

I improve AI models through high-volume annotation, RLHF evaluation, and rigorous quality analysis.

Kenya

Message

What I'm looking for

I'm looking for opportunities in AI data operations, LLM evaluation, quality assurance, or multilingual AI work where I can improve data quality, support model alignment, and contribute to rigorous operational standards.

I've supported AI data operations at Sama, Innodata, Micro1, and Label Your Data, evaluating model outputs, annotating computer-vision data, and improving quality against evolving project standards.

At Sama, I annotated more than 1,000 bounding boxes daily at 98% QA accuracy and produced daily, weekly, and monthly quality reports. I also analyzed agent output, shared targeted coaching feedback with Team Leaders, and partnered with Operations to address recurring quality gaps.

My work includes RLHF for LLM tuning, factuality, safety, and reasoning evaluation, multilingual content evaluation, and identifying AI hallucinations in robotics video data. As a native/bilingual English and Swahili speaker, I bring cultural nuance to AI alignment and translation work.

Beyond AI, I've improved records retrieval, managed high-volume NHIF claims, handled cash and banking accurately, and built a WordPress lifestyle and wellness blog with SEO, metadata, and media organization.

Experience

Work history, roles, and key accomplishments

Current

Independent AI Specialist

Current

Innodata

Oct 2025 - Present (10 months)

Evaluating LLM outputs for factuality, safety, and reasoning. Executing high-priority Computer Vision tasks with strict adherence to evolving project rubrics.

LLM Tuning Data Tagging Computer Vision Quality Assurance

Independent AI Specialist

Micro1

May 2026 - Jun 2026 (1 month)

Evaluated video data for a robotics project, verifying action recognition and timestamp accuracy. Identified and corrected AI-generated hallucinations, rewriting problematic sections to improve output quality.

Action Recognition Data Annotation Quality Assurance

Independent AI Specialist

Label Your Data

Jul 2025 - Dec 2025 (5 months)

Conducted web-based annotation and data cloning tasks in fast-paced remote environments.

Data Annotation

Independent Travel Manager

Dreamport

Jan 2025 - Mar 2025 (2 months)

Led handling and bookings of airline tickets and associated travel services for end-clients. Responded to calls from end-clients and provided detailed inquiries/consultations.

Travel Booking Customer Service Consultation

AI Associate / Reviewer / Quality Analyst

Sama

Apr 2021 - Dec 2024 (3 years 8 months)

Annotated 1,000+ bounding boxes daily at 98% QA accuracy. Analyzed agent output against guidelines, provided feedback to Team Leaders, and compiled quality reports for stakeholders.

Data Annotation Bounding Boxes Quality Assurance Team Leadership Reporting

Records Officer / Front Office Manager

Afraha Maternity & Nursing Home

May 2017 - Apr 2021 (3 years 11 months)

Reduced data retrieval times by 25% through systematic entry protocols and enhanced integrity. Optimized NHIF claims handling for 1,000+ cases monthly, improving patient satisfaction. Managed monthly banking/cash handling of over 1 Million KES with 100% accuracy.

Records Management Data Integrity NHIF Claims Cash Handling