Kate Oloyede
@kateoloyede
AI QA trainer specializing in LLM evaluation, prompt engineering, and hallucination detection.
What I'm looking for
I am an AI QA Trainer and Evaluation Writer with over five years of hands-on experience designing, testing, and validating complex written systems for automated and semi-automated workflows.
I specialize in prompt-driven evaluation, hallucination and factuality detection, scenario and test case design, and rubric-based scoring to produce reproducible evaluation data for large-scale language models.
I have built gold-standard examples, defined failure modes, and iteratively refined prompts and scenarios to improve reliability, coverage, and instruction adherence in AI outputs.
I bring practical experience tuning system prompts, creating adversarial prompts, and conducting regression testing with structured prompt templates (JSON/YAML), supported by a background in logical reasoning and bias analysis from a B.Sc. in Political Science.
Experience
Work history, roles, and key accomplishments
AI Content & Prompt Specialist
Freelance
Jan 2020 - Present (6 years)
Provide prompt design, adversarial testing, and evaluation scoring for clients; create multi-turn scenarios, annotate failures for factuality/coherence/safety, and tune system prompts to improve grounding.
AI QA Trainer
Authors Writers
Jan 2020 - Dec 2023 (3 years 11 months)
Designed prompt-driven evaluation scenarios and gold-standard examples, validated and reviewed high-volume structured outputs, and detected failure modes to improve LLM reliability and rubric-based scoring.
Education
Degrees, certifications, and relevant coursework
Ambrose Alli University
Bachelor of Science, Political Science
2011 - 2015
Completed a Bachelor of Science in Political Science, developing skills in logic, systems thinking, and bias analysis relevant to LLM evaluation.
Availability
Location
Authorized to work in
Job categories
Interested in hiring Kate?
You can contact Kate and 90k+ other talented remote workers on Himalayas.
Message KateFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
