Yamalith Díaz
@yamalithdaz
I evaluate AI responses and ensure trust & safety with QA rigor.
What I'm looking for
I’m an AI evaluator and QA specialist with 4+ years in high-volume content review and trust & safety operations, focused on accuracy, judgment quality, and clear feedback. I’ve worked across real estate and leasing domain prompts as well as high-sensitivity moderation workflows.
In my AI Domain Expert role, I evaluate model responses using a 6-dimension rubric—Instruction Following, Truthfulness, Correctness, Writing Quality, Verbosity, and Overall Quality. I also run comparative pairwise evaluations, selecting preferred outputs and writing detailed justifications per dimension, then stress-test reasoning with domain-specific prompts.
Previously, I was promoted from line moderator to QA specialist at Teleperformance/ByteDance (TikTok), where I audited policy compliance, maintained 97–100% accuracy, and consistently ranked top performer. I analyzed edge cases and identified policy gaps in queues (including Hate Speech, Graphic Content, and Violent Behavior) and delivered calibration feedback with me as the SME point of contact for escalations.
I bring strong operational discipline from moderation and content quality roles, reviewing 1,000–1,300 items/day and supporting onboarding and policy Q&A for team members. I’m open to AI evaluation, RLHF annotation, data quality, and Trust & Safety roles where rubric-based quality and continuous calibration make measurable impact.
Experience
Work history, roles, and key accomplishments
AI Domain Expert (Real Estate)
Mercor
Jan 2026 - Present (5 months)
Evaluated AI model responses for real estate and leasing using a 6-dimension rubric (instruction following, truthfulness, correctness, writing quality, verbosity, overall quality). Conducted comparative pairwise scoring and produced detailed justifications, while writing domain-specific prompts to stress-test reasoning.
Trust & Safety QA Analyst
Teleperformance
Oct 2025 - Mar 2026 (5 months)
Audited trust & safety moderation decisions for policy compliance at TikTok, maintaining 97–100% accuracy and ranking top performer. Analyzed edge cases, identified policy gaps, and delivered structured calibration feedback as an escalation SME.
Content Moderator (BR)
Teleperformance
Oct 2024 - Oct 2025 (1 year)
Reviewed 1,000–1,300 items per day for TikTok Brazil with an error rate of ~2/week versus a team average of 20. Applied policies consistently to sensitive, context- and culture-dependent content categories and supported onboarding by answering policy questions.
Content Quality Specialist
Konecta
Mar 2023 - Oct 2024 (1 year 7 months)
Reviewed e-commerce media and product listings for policy compliance in high-volume environments. Localized product content from EN to ES and maintained consistent decision-making under time pressure.
Education
Degrees, certifications, and relevant coursework
Yamalith hasn't added their education
Don't worry, there are 90k+ talented remote workers on Himalayas
Availability
Location
Authorized to work in
Portfolio
notion.so/yamalith-portfolioJob categories
Skills
Interested in hiring Yamalith?
You can contact Yamalith and 90k+ other talented remote workers on Himalayas.
Message YamalithFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
