Himalayas logo
KO
Open to opportunities

Kate Oloyede

@kateoloyede

AI QA trainer specializing in LLM evaluation, prompt engineering, and hallucination detection.

Nigeria
Message

What I'm looking for

I seek roles where I can lead LLM evaluation and prompt engineering efforts, improve model reliability through structured testing, and help teams deploy safe, factual AI.

I am an AI QA Trainer and Evaluation Writer with over five years of hands-on experience designing, testing, and validating complex written systems for automated and semi-automated workflows.

I specialize in prompt-driven evaluation, hallucination and factuality detection, scenario and test case design, and rubric-based scoring to produce reproducible evaluation data for large-scale language models.

I have built gold-standard examples, defined failure modes, and iteratively refined prompts and scenarios to improve reliability, coverage, and instruction adherence in AI outputs.

I bring practical experience tuning system prompts, creating adversarial prompts, and conducting regression testing with structured prompt templates (JSON/YAML), supported by a background in logical reasoning and bias analysis from a B.Sc. in Political Science.

Experience

Work history, roles, and key accomplishments

AW

AI QA Trainer

Authors Writers

Jan 2020 - Dec 2023 (3 years 11 months)

Designed prompt-driven evaluation scenarios and gold-standard examples, validated and reviewed high-volume structured outputs, and detected failure modes to improve LLM reliability and rubric-based scoring.

Education

Degrees, certifications, and relevant coursework

AU

Ambrose Alli University

Bachelor of Science, Political Science

2011 - 2015

Completed a Bachelor of Science in Political Science, developing skills in logic, systems thinking, and bias analysis relevant to LLM evaluation.

Tech stack

Software and tools used professionally

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Kate Oloyede - AI Content & Prompt Specialist - Freelance | Himalayas