Skip to main content
MUCHERU PIUS MACHARIAMM
Looking for a job

MUCHERU PIUS MACHARIA

@mucherupiusmacharia

AI Model Evaluator on remote AI projects who completed 10,000+ evaluation tasks and improved reviewer consistency.

Kenya
Message

On remote AI evaluation projects, I completed 10,000+ tasks across finance, reasoning, coding, and general knowledge, assessing model responses against detailed quality rubrics.

I evaluated LLM responses, ranked preferences for RLHF workflows, and compared models to identify hallucinations, reasoning errors, and factual inconsistencies. I also created reusable evaluation templates and quality processes that improved reviewer consistency and reduced turnaround time by approximately 25%.

As a Senior Data Annotation Specialist on remote AI data projects, I annotated and validated 250,000+ text, image, and document records for machine learning datasets. I maintained 99% annotation accuracy and reviewed complex data to correct labeling inconsistencies.

Earlier, as an AI Data Quality Analyst and Legal Document Review Specialist, I validated training datasets, prepared quality reports, and extracted structured information from legal records. I use Python and Excel to analyze evaluation trends and identify recurring model failure patterns.

Experience

Work history, roles, and key accomplishments

IC
Current

AI Model Evaluator / Generative AI Quality Analyst

Independent Contractor

Jan 2021 - Present (5 years 10 months)

Completed 10,000+ AI evaluation tasks across finance, reasoning, coding, and general knowledge domains, assessing model responses against detailed quality rubrics. Performed LLM response evaluation, ranking, and preference labeling to support RLHF workflows.

RP

AI Data Quality Analyst

Remote AI Data Projects

Jan 2020 - Dec 2022 (2 years 11 months)

Validated large-scale AI training datasets and identified annotation errors affecting model performance. Generated quality reports highlighting data trends and recommended corrective actions.

RP

Legal Document Review Specialist

Remote AI Data Projects

Jan 2018 - Dec 2020 (2 years 11 months)

Reviewed confidential legal records for accuracy, compliance, and structured information extraction. Maintained detailed audit records and quality reports.

Education

Degrees, certifications, and relevant coursework

Westcliff University logoWU

Westcliff University

Master of Science, Computer Science

Pursuing a Master of Science in Computer Science with an Artificial Intelligence specialization.

University of Illinois logoUI

University of Illinois

Bachelor of Science, Statistics and Computer Science

Earned a Bachelor of Science in Statistics and Computer Science.

GO

Google

Professional Certificate, Data Analytics

Completed the Google Data Analytics Professional Certificate.

IB

IBM

Professional Certificate, Data Science

Completed the IBM Data Science Professional Certificate.

MI

Microsoft

Microsoft Azure AI Fundamentals (AI-900), Artificial Intelligence

Earned the Microsoft Azure AI Fundamentals (AI-900) certification.

PA

Python for Data Analysis

Course, Data Analysis

Completed a course in Python for Data Analysis.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan