Sarah Odunayo Oladunjoye
@sarahodunayooladunjo
AI Prompt Engineer and LLM Evaluator specializing in RLHF-style evaluation, hallucination detection, and high-quality AI training data.
What I'm looking for
I’m an AI Prompt Engineer and LLM Evaluator with 4+ years of experience supporting AI training through prompt development, structured evaluation, and dataset validation. I focus on improving model outputs with quality-focused decision making across Generative AI / NLP initiatives.
In my work, I develop and test prompts for summarization, classification, reasoning, extraction, and instruction-following. I also rank and compare AI-generated responses for accuracy, relevance, clarity, and adherence to project requirements, including RLHF-style preference ranking workflows.
I’m especially strong in rubric-based evaluation, factuality assessment, hallucination detection, and safety review. I apply source verification and document findings to identify unsupported claims, biased content, unsafe outputs, and instruction-following failures—helping teams protect dataset integrity and evaluation standards.
Across remote projects, I’ve contributed to large-scale annotation and QA, from reviewing 1,000+ outputs to validating 4,000+ text, image, and audio samples. I build reusable prompt libraries and LLM evaluation frameworks to support consistent, repeatable training and grading outcomes.
Experience
Work history, roles, and key accomplishments
AI Prompt Engineer & Annotator
Freelance
Jan 2025 - Present (1 year 6 months)
Developed and tested 500+ prompts across summarization, classification, reasoning, extraction, and instruction-following tasks. Evaluated ranked preferences with rubric-based, factuality- and hallucination-aware workflows supporting RLHF-style model training.
Data Annotator & AI Content Reviewer
Atlas Capture
Jan 2023 - Jan 2025 (2 years)
Reviewed and evaluated 1,000+ AI-generated outputs for classification, sentiment analysis, and language understanding tasks while applying annotation guidelines. Performed rubric-aligned safety and instruction-following checks, including preference ranking and comparative assessments.
AI Data Contributor
RemoExpert
Jan 2021 - Jan 2023 (2 years)
Annotated and validated 4,000+ text, image, and audio samples for AI training and data annotation projects. Completed quality-control reviews and guideline compliance checks to support dataset preparation and validation workflows.
Education
Degrees, certifications, and relevant coursework
Lagos State University
Bachelor of Arts (B.A.), English
2018 - 2023
Grade: Second Class Upper Honours
Earned a Bachelor of Arts (B.A.) in English from Lagos State University, graduating with Second Class Upper Honours.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Sarah Odunayo?
You can contact Sarah Odunayo and 90k+ other talented remote workers on Himalayas.
Message Sarah OdunayoGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
