Looking for a job

DeAndre Callaway

@deandrecallaway

Message

Senior Content Editor at AI Content Labs improving AI-generated content accuracy by 42% through rubric development.

United States

Message

What I'm looking for

I’m interested in advancing generative AI through precise writing and content evaluation, including training and evaluating language models and improving AI-generated content.

At AI Content Labs, I lead quality assurance for AI-generated content and improved accuracy scores by 42% through rubric development. I also train and supervise writers evaluating machine-generated text and collaborate with NLP engineers to identify recurring semantic coherence errors.

At Stanford NLP Lab, I annotated sentence pairs for machine translation training sets, co-authored an ACL 2021 paper on subtle grammatical errors in LLM outputs, and developed grading rubrics adopted by the university's AI writing assessment program. My work also includes creating AI-Assisted Writing Standards adopted by three Fortune 500 companies.

Experience

Work history, roles, and key accomplishments

Current

Senior Content Editor

Current

AI Content Labs

Jan 2021 - Present (5 years 9 months)

Lead quality assurance for AI-generated content, improving accuracy scores by 42% through rubric development. Train and supervise a team of 12 writers in evaluating machine-generated text.

AI Training Quality Assurance Rubric Development Team Leadership NLP Semantic Coherence Labelbox Google Docs Grammarly Hemingway Editor

Graduate Research Assistant

Stanford NLP Lab

Jan 2019 - Jan 2021 (2 years)

Annotated 10,000+ sentence pairs for machine translation training sets. Co-authored paper on Detecting Subtle Grammatical Errors in LLM Outputs (ACL 2021) and developed grading rubrics adopted by the university's AI writing assessment program.

Annotations Machine Translation NLP Computational Linguistics Research Paper Writing Rubric