Open to opportunities

Paula Kilonzo

@paulakilonzo

Message

Detail-oriented LLM evaluation specialist ensuring factual, logical, and communicative model outputs.

United States

Message

What I'm looking for

I seek full-time or contract roles in LLM evaluation or AI quality assurance where I can apply rigorous fact-checking, rubric-based annotation, and clear feedback to improve model safety and reliability.

I am a detail-oriented LLM evaluation specialist with a strong academic foundation in data analytics and applied computer science. I have extensive experience evaluating model outputs for factual accuracy, reasoning quality, clarity, tone, and completeness using structured taxonomies and rubrics.

As an independent contractor and research/content quality analyst, I performed rigorous fact-checking against trusted public sources, applied benchmarked scoring systems, and produced high-quality human evaluation data. I identify subtle logical flaws, hallucinations, and communication issues, providing clear, actionable feedback that improved model performance prior to production release.

I am reliable in following complex instructions, adapt quickly across domains, and prioritize safety and policy alignment to strengthen end-user trust and support the development of accurate, user-aligned AI systems.

Experience

Work history, roles, and key accomplishments

LLM Evaluation Specialist

Independent Contractor

Evaluated LLM-generated responses for factual accuracy, reasoning quality, tone, and completeness using detailed rubrics and authoritative sources, producing high-quality annotations that improved model reliability prior to deployment.

Fact Checking Annotations Quality Assurance Critical Reasoning Technical Writing Data Analysis

Education

Degrees, certifications, and relevant coursework

California State University, Sacramento

Bachelor of Science, Data Analytics / Applied Computer Science

Completed a Bachelor of Science in Data Analytics / Applied Computer Science with coursework in applied statistics, discrete mathematics, data structures and algorithms, logic and critical thinking, and research methods and technical writing.