
Peter Kigen
@peterkigen
AI Evaluation Specialist performing RLHF response ranking and reviewing language-model training data.
What I'm looking for
In my current AI Data Annotation & Evaluation Specialist role, I annotate and review large language model training data across general knowledge, reasoning, and safety domains. I’ve completed 8,000+ annotation and evaluation tasks.
I rank model responses using RLHF-style evaluation and write evidence-based justifications against accuracy, helpfulness, coherence, and safety criteria. I also flag edge cases and ambiguities that contribute to improvements in evaluation rubrics.
At Scale AI, I reviewed AI-generated text for factual accuracy, relevance, tone, and policy compliance in RLHF and supervised fine-tuning data pipelines. I provided structured feedback for preference models and achieved top-quartile quality metrics during my internship.
My capstone at United States International University – Africa involved developing and evaluating a multi-turn conversational AI agent focused on factual accuracy and safety alignment. I ranked responses and conducted preference modeling across 1,200+ generated outputs.
Experience
Work history, roles, and key accomplishments
AI Data Annotation & Evaluation Specialist
Unknown
Jan 2024 - Present (2 years 8 months)
Performed high-volume data annotation, content labeling, and quality review for large language model training datasets. Conducted preference ranking (RLHF-style) of model responses and maintained consistent quality scores above platform averages.
Data Annotation Specialist
Various AI Data Platforms
Jan 2023 - Jan 2024 (1 year)
Executed text classification, entity recognition, sentiment analysis, and content moderation tasks for computer vision and NLP model training. Built strong foundation in following precise labeling guidelines and delivering consistent, high-accuracy annotations under volume targets.
Reviewed and rated AI-generated text for factual accuracy, relevance, tone, and policy compliance as part of large-scale RLHF and supervised fine-tuning data pipelines. Applied complex multi-dimensional rubrics to score responses and provided structured written feedback.
Education
Degrees, certifications, and relevant coursework
United States International University – Africa (USIU-Africa)
Bachelor of Science, Artificial Intelligence
Activities and societies: Capstone Project: Developed and evaluated a multi-turn conversational AI agent focused on factual accuracy and safety alignment; conducted systematic response ranking and preference modeling (RLHF-style evaluation) across 1,200+ generated outputs.
Bachelor of Science in Artificial Intelligence with relevant coursework in machine learning, natural language processing, AI ethics and safety, data mining, human-computer interaction, and statistical analysis. Capstone project involved developing and evaluating a multi-turn conversational AI agent focused on factual accuracy and safety alignment.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Interested in hiring Peter?
You can contact Peter and 90k+ other talented remote workers on Himalayas.
Message PeterGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
