Deeana Dorsey
@deeanadorsey
Senior AI Training Specialist at DataForce by TransPerfect who cut annotation errors from 9.4% to 2.1% with a multi-tier QA protocol.
United StatesWhat I'm looking for
At DataForce by TransPerfect, I lead a distributed annotation team delivering RLHF and comparative-ranking data for LLM fine-tuning engagements. I designed a multi-tier QA protocol that reduced annotation errors from 9.4% to 2.1%.
I also developed prompt durability and adversarial robustness evaluations that increased model safety alignment scores by 31% over two training cycles. My evaluation rubrics cover instruction-following, factual accuracy, tone, and refusal behavior across generative text and multimodal outputs.
At Appen Limited, I managed quality for NLP and conversational AI dataset projects and developed training materials and edge-case decision trees that improved new annotators’ accuracy by 27% within two weeks. I also helped standardize dialogue-act taxonomies, reducing label inconsistency by 44%.
Across my work at Scale AI and Lionbridge AI (now TELUS International AI), I contributed to datasets for computer vision, NLP, and multimodal AI, including 80,000+ labeled assets with a 98.7% quality acceptance rate. I’ve also built Python and Tableau QA tools and worked on RLHF preference pipelines, adversarial testing, and multilingual annotation quality.
Experience
Work history, roles, and key accomplishments
Senior AI Training Specialist & Evaluation Lead
DataForce by TransPerfect
Jan 2023 - Present (3 years 10 months)
Lead a 20-person distributed annotation team delivering RLHF and comparative ranking data for LLM fine-tuning engagements. Designed QA protocols and evaluation frameworks that improved model safety alignment and reduced annotation error rates.
Managed end-to-end quality lifecycle for 12+ concurrent NLP and conversational AI dataset projects, overseeing 250,000+ annotated examples. Developed training materials and decision trees that improved annotator accuracy and reduced label inconsistency.
Produced high-fidelity training datasets for computer vision, NLP, and multimodal AI systems, maintaining a 98.7% quality acceptance rate across 80,000+ labeled assets. Authored verification protocols and workflow guides adopted as onboarding standards.
Evaluated and ranked search engine results, conversational AI responses, and image recognition outputs for quality and relevance. Contributed to training data pipelines for voice assistant and NLU models.
Education
Degrees, certifications, and relevant coursework
University of Miami
Master of Business Administration, Business Analytics
2018 - 2020
Grade: 3.86 / 4.00
Activities and societies: Beta Gamma Sigma
Master of Business Administration with a concentration in Business Analytics, achieving a GPA of 3.86 and Beta Gamma Sigma honors.
Florida International University
Bachelor of Business Administration, Finance
2010 - 2014
Grade: 3.81 / 4.00
Activities and societies: Magna Cum Laude, Beta Alpha Psi Honor Society
Bachelor of Business Administration in Finance, graduating Magna Cum Laude with a GPA of 3.81 and membership in Beta Alpha Psi.
Availability
Location
United StatesAuthorized to work in
Salary expectations
Job categories
Interested in hiring Deeana?
You can contact Deeana and 90k+ other talented remote workers on Himalayas.
Message DeeanaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
