Skip to main content
PK
Looking for a job

Peter Kigen

@peterkigen

AI Evaluation Specialist performing RLHF response ranking and reviewing language-model training data.

Kenya
Message

What I'm looking for

I’m seeking AI Evaluation / AI Training Analyst opportunities where I can contribute high-quality human feedback to frontier model development. I’m open to domain-specific evaluation across general AI, STEM reasoning, business, legal, and multilingual tasks.

In my current AI Data Annotation & Evaluation Specialist role, I annotate and review large language model training data across general knowledge, reasoning, and safety domains. I’ve completed 8,000+ annotation and evaluation tasks.

I rank model responses using RLHF-style evaluation and write evidence-based justifications against accuracy, helpfulness, coherence, and safety criteria. I also flag edge cases and ambiguities that contribute to improvements in evaluation rubrics.

At Scale AI, I reviewed AI-generated text for factual accuracy, relevance, tone, and policy compliance in RLHF and supervised fine-tuning data pipelines. I provided structured feedback for preference models and achieved top-quartile quality metrics during my internship.

My capstone at United States International University – Africa involved developing and evaluating a multi-turn conversational AI agent focused on factual accuracy and safety alignment. I ranked responses and conducted preference modeling across 1,200+ generated outputs.

Experience

Work history, roles, and key accomplishments

UN
Current

AI Data Annotation & Evaluation Specialist

Unknown

Jan 2024 - Present (2 years 10 months)

Performed high-volume data annotation, content labeling, and quality review for large language model training datasets. Conducted preference ranking (RLHF-style) of model responses and maintained consistent quality scores above platform averages.

Education

Degrees, certifications, and relevant coursework

United States International University – Africa (USIU-Africa) logoUU

United States International University – Africa (USIU-Africa)

Bachelor of Science, Artificial Intelligence

Activities and societies: Capstone Project: Developed and evaluated a multi-turn conversational AI agent focused on factual accuracy and safety alignment; conducted systematic response ranking and preference modeling (RLHF-style evaluation) across 1,200+ generated outputs.

Bachelor of Science in Artificial Intelligence with relevant coursework in machine learning, natural language processing, AI ethics and safety, data mining, human-computer interaction, and statistical analysis. Capstone project involved developing and evaluating a multi-turn conversational AI agent focused on factual accuracy and safety alignment.

Tech stack

Software and tools used professionally

Availability

Looking for a job

Location

Kenya

Authorized to work in

Salary expectations

60k+ USD

Job categories

AI AnalystAI EvaluatorData Annotator
Content Quality Reviewer

Interested in hiring Peter?

You can contact Peter and 600K+ other talented remote workers on Himalayas.

Message Peter

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan