Skip to main content
Sarah Odunayo OladunjoyeSO
Open to opportunities

Sarah Odunayo Oladunjoye

@sarahodunayooladunjo

AI Prompt Engineer and LLM Evaluator specializing in RLHF-style evaluation, hallucination detection, and high-quality AI training data.

Nigeria
Message

What I'm looking for

I’m looking for remote work where I can engineer prompts and evaluate LLM responses using rubric-based methods, hallucination detection, and safety review—supporting RLHF pipelines and high-quality Generative AI/NLP training with clear documentation and impact.

I’m an AI Prompt Engineer and LLM Evaluator with 4+ years of experience supporting AI training through prompt development, structured evaluation, and dataset validation. I focus on improving model outputs with quality-focused decision making across Generative AI / NLP initiatives.

In my work, I develop and test prompts for summarization, classification, reasoning, extraction, and instruction-following. I also rank and compare AI-generated responses for accuracy, relevance, clarity, and adherence to project requirements, including RLHF-style preference ranking workflows.

I’m especially strong in rubric-based evaluation, factuality assessment, hallucination detection, and safety review. I apply source verification and document findings to identify unsupported claims, biased content, unsafe outputs, and instruction-following failures—helping teams protect dataset integrity and evaluation standards.

Across remote projects, I’ve contributed to large-scale annotation and QA, from reviewing 1,000+ outputs to validating 4,000+ text, image, and audio samples. I build reusable prompt libraries and LLM evaluation frameworks to support consistent, repeatable training and grading outcomes.

Experience

Work history, roles, and key accomplishments

FR
Current

AI Prompt Engineer & Annotator

Freelance

Jan 2025 - Present (1 year 6 months)

Developed and tested 500+ prompts across summarization, classification, reasoning, extraction, and instruction-following tasks. Evaluated ranked preferences with rubric-based, factuality- and hallucination-aware workflows supporting RLHF-style model training.

Education

Degrees, certifications, and relevant coursework

LU

Lagos State University

Bachelor of Arts (B.A.), English

2018 - 2023

Grade: Second Class Upper Honours

Earned a Bachelor of Arts (B.A.) in English from Lagos State University, graduating with Second Class Upper Honours.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan