Looking for a job

BRANDON TAFT

@brandontaft

Message

I've completed 10,000+ LLM evaluations and improved AI review consistency through rigorous quality frameworks.

United States

Message

What I'm looking for

I'm looking to apply my LLM evaluation, RLHF, data annotation, and quality-analysis experience to improve AI training data, model outputs, and evaluation workflows.

I've completed 10,000+ AI evaluation tasks across finance, reasoning, coding, and general knowledge, assessing model outputs against detailed quality rubrics. My work includes LLM response ranking, preference labeling, hallucination detection, and RLHF support.

Across remote AI evaluation projects, I've built reusable templates, checklists, and quality processes that improved reviewer consistency and reduced turnaround time by approximately 25%. I use Python and Excel to identify recurring failure patterns and have maintained 98%+ agreement with reference answers.

I've also annotated and validated more than 250,000 text, image, and document records, maintaining 99% annotation accuracy. Earlier legal document review work strengthened my approach to confidential records, structured information extraction, compliance, audit documentation, and quality reporting.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Annotation Specialist

Current

Remote AI Data Projects

Jan 2024 - Present (2 years 8 months)

Annotated and validated 250,000+ text, image, and document-based records for machine learning training datasets. Performed quality assurance audits to ensure annotation accuracy and consistency.

Data Annotation Data Validation Quality Assurance Prompt Evaluation Preference Ranking Model Output Validation

Current

AI Model Evaluator / Generative AI Quality Analyst

Current

Remote AI Evaluation Projects

Jan 2021 - Present (5 years 8 months)

Completed 10,000+ AI evaluation tasks across finance, reasoning, coding, and general knowledge domains, assessing model responses against detailed quality rubrics. Performed LLM response evaluation, ranking, and preference labeling to support RLHF workflows.

LLM Evaluation RLHF Prompt Testing Data Annotation Python Excel Quality Assurance Error Analysis

AI Data Quality Analyst

Remote AI Data Projects

Jan 2020 - Dec 2022 (2 years 11 months)

Validated large-scale AI training datasets and identified annotation errors affecting model performance. Partnered with technical teams to improve labeling guidelines and quality standards.

Data Validation Quality Assurance Error Analysis data review Reporting

Legal Document Review Specialist

Remote AI Data Projects

Jan 2016 - Dec 2020 (4 years 11 months)

Reviewed confidential legal records for accuracy, compliance, and structured information extraction. Identified inconsistencies and ensured documentation met quality and regulatory requirements.

Document Review Data Extraction Quality Assurance Compliance