Skip to main content
PK
Looking for a job

Peter Kigen

@peterkigen

AI Evaluation Specialist performing RLHF response ranking and reviewing language-model training data.

Kenya
Message

What I'm looking for

I’m seeking AI Evaluation / AI Training Analyst opportunities where I can contribute high-quality human feedback to frontier model development. I’m open to domain-specific evaluation across general AI, STEM reasoning, business, legal, and multilingual tasks.

In my current AI Data Annotation & Evaluation Specialist role, I annotate and review large language model training data across general knowledge, reasoning, and safety domains. I’ve completed 8,000+ annotation and evaluation tasks.

I rank model responses using RLHF-style evaluation and write evidence-based justifications against accuracy, helpfulness, coherence, and safety criteria. I also flag edge cases and ambiguities that contribute to improvements in evaluation rubrics.

At Scale AI, I reviewed AI-generated text for factual accuracy, relevance, tone, and policy compliance in RLHF and supervised fine-tuning data pipelines. I provided structured feedback for preference models and achieved top-quartile quality metrics during my internship.

My capstone at United States International University – Africa involved developing and evaluating a multi-turn conversational AI agent focused on factual accuracy and safety alignment. I ranked responses and conducted preference modeling across 1,200+ generated outputs.

Experience

Work history, roles, and key accomplishments

UN
Current

AI Data Annotation & Evaluation Specialist

Unknown

Jan 2024 - Present (2 years 8 months)

Performed high-volume data annotation, content labeling, and quality review for large language model training datasets. Conducted preference ranking (RLHF-style) of model responses and maintained consistent quality scores above platform averages.

Education

Degrees, certifications, and relevant coursework

UU

United States International University – Africa (USIU-Africa)

Bachelor of Science, Artificial Intelligence

Activities and societies: Capstone Project: Developed and evaluated a multi-turn conversational AI agent focused on factual accuracy and safety alignment; conducted systematic response ranking and preference modeling (RLHF-style evaluation) across 1,200+ generated outputs.

Bachelor of Science in Artificial Intelligence with relevant coursework in machine learning, natural language processing, AI ethics and safety, data mining, human-computer interaction, and statistical analysis. Capstone project involved developing and evaluating a multi-turn conversational AI agent focused on factual accuracy and safety alignment.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan