Looking for a job

Derrick Kibui

@derrickkibui

Message

AI Training & Data Annotation Specialist at Handshake AI who evaluated LLM responses and reviewed AI-generated code.

Kenya

Message

At Handshake AI, I evaluated and ranked large language model responses for accuracy, helpfulness, tone, and adherence to task guidelines. I also reviewed AI-generated code, flagged logic errors, and suggested corrected implementations.

At Mercor, I fact-checked AI-generated content and verified sources before dataset submission. I compared model responses and provided structured feedback for fine-tuning, including in coding-focused evaluations.

At Outlier, I rated AI responses for helpfulness, coherence, and safety in RLHF training pipelines. I wrote prompts and reference answers, and reported inconsistencies, hallucinations, and factual errors.

Experience

Work history, roles, and key accomplishments

AI Trainer / Data Annotation Specialist

Handshake AI

Jan 2025 - Jul 2026 (1 year 6 months)

Evaluated and ranked LLM responses for accuracy and adherence to guidelines. Reviewed and debugged AI-generated code, wrote prompts, and collaborated with project leads to apply evolving rubrics.

AI model evaluation RLHF Prompt Engineering Code Review Debugging Fact Checking Data Annotation

AI Data Annotator

Mercor

Jul 2023 - Nov 2024 (1 year 4 months)

Performed fact-checking and source verification on AI-generated content. Ranked model responses and completed coding-focused evaluation tasks while maintaining high task-quality scores.

Fact Checking Data Annotation Model Evaluation Code Review Quality Assurance

AI Model Evaluator

Outlier

Jan 2022 - Jun 2023 (1 year 5 months)

Rated AI-generated responses for helpfulness, coherence, and safety in RLHF pipelines. Wrote prompts and reference answers, identified inconsistencies, and adapted to frequent guideline updates.

AI model evaluation RLHF Prompt Engineering Data Annotation Quality Assurance