Open to opportunities

Ruth User

@ruthuser10

AI Trainer and language evaluator specializing in guideline-based annotation, prompt engineering, and linguistic quality assessment.

Canada

Message

What I'm looking for

I’m looking for work training and evaluating language models using clear rubrics—where I can deliver accurate, fluent, coherent, tone-consistent outputs, improve prompts, and support high-quality datasets while working effectively in a remote environment.

I’m a Senior AI Trainer and Language Evaluator with 5+ years of experience training and evaluating AI systems through data annotation, prompt development, language assessment, content review, SAMOEI, and quality assurance. I rank and compare AI outputs using structured evaluation frameworks to ensure accuracy, fluency, coherence, relevance, and linguistic quality.

I provide detailed written feedback to improve response quality and model behavior, using skills like RLHF evaluation, AI response ranking alignment, and guideline-based annotation. I also conduct quality assurance checks for annotation consistency and project compliance, including grammar, style, tone, clarity, and factual consistency.

Alongside my AI work, I’ve been a Communications Specialist with a focus on technical writing, stakeholder engagement, documentation, and editing/proofreading. I coordinate communication across teams and partners, translate complex project information into accessible language, and support content quality review to ensure clarity and audience relevance.

I’m currently a Master’s candidate in Linguistics at the University of Toronto, with research interests including Artificial Intelligence & Language Technologies, Linguistic Data Annotation, Natural Language Processing, and Language Model Evaluation. I bring a strong linguistic foundation and a detail-oriented, remote-first work ethic to every task.

Experience

Work history, roles, and key accomplishments

Current

Senior AI Trainer & Language Evaluator

Current

Taskverse

Jan 2021 - Present (5 years 6 months)

Evaluate and compare AI outputs using detailed project guidelines, focusing on accuracy, fluency, coherence, relevance, consistency, tone, factual correctness, and linguistic quality. Support language model improvement through data annotation, prompt work, RLHF evaluation, and quality assurance.

AI Training And Evaluation Prompt Engineering Data Annotation Language Model Evaluation Quality Assurance Linguistic Analysis Grammar Tone Evaluation Clarity Content Review Editing Proofreading

Current

Senior AI Trainer & Language Evaluator

Current

Turing

Jan 2021 - Present (5 years 6 months)

Rank and evaluate AI-generated outputs for accuracy, fluency, coherence, relevance, consistency, tone, factual correctness, and linguistic quality. Perform data annotation, prompt refinement, RLHF evaluation, and quality assurance per detailed project guidelines.

AI Training And Evaluation Prompt Engineering Data Annotation Language Model Evaluation Quality Assurance Linguistic Analysis Grammar Tone Evaluation Clarity Content Review Editing Proofreading

Current

Senior AI Trainer & Language Evaluator

Current

Rws

Jan 2021 - Present (5 years 6 months)

Rank and evaluate AI-generated outputs for accuracy, fluency, coherence, relevance, consistency, tone, factual correctness, and linguistic quality. Conduct prompt and dataset-related work including data annotation, RLHF evaluation, and quality assurance against detailed project guidelines.

AI Training And Evaluation Prompt Engineering Data Annotation Language Model Evaluation Quality Assurance Linguistic Analysis Grammar Tone Evaluation Clarity Content Review Editing Proofreading

Current

Communication Specialist

Current

Lapsset

Jan 2020 - Present (6 years 6 months)

Develop and edit clear, accurate communication materials for project reporting and stakeholder engagement. Support content quality assurance through language assessment, grammar and tone analysis, text classification, and documentation.

Communication Strategy Stakeholder Engagement Remote Collaboration Written Communication Editing Proofreading Language Assessment Grammar and Tone Analysis Content quality review Content Review Documentation Factual Consistency Checking Reporting

Volunteer Communications Officer

Usaid-Supported Programme

Jan 2015 - Jan 2016 (1 year)

Support programme communications, outreach, and public awareness activities, including preparation of reports, field updates, newsletters, and documentation. Help collect, organize, and verify information for communication and reporting.

Program Communications Outreach Reports Newsletters Summaries Documentation

Education

Degrees, certifications, and relevant coursework

University of Toronto

Master of Arts, Linguistics

2026 - 2027

Master of Arts in Linguistics with coursework in Applied Linguistics, Language Processing, Syntax & Semantics, Corpus Linguistics, Research Methods, and Discourse Analysis. Expected completion in April 2027.