André Varela
@andrvarela
AI Trainer and Data Quality Specialist specializing in language model evaluation and LLM quality.
What I'm looking for
I’m an AI Data Evaluator and trainer specializing in language model evaluation (LLM). I have hands-on experience in RLHF and Side-by-Side (SxS), executing 200+ SxS/Likert assessments monthly and validating 50+ AI reasoning traces weekly using JSON/YAML to ensure safety and accuracy.
I also evaluate PT-PT content for cultural nuance, regional idioms, and bias & safety, identifying and classifying 30+ edge cases per week, including hallucinations and safety violations. With a background in operational data coordination and independent entrepreneurship, I bring analytical rigor, critical thinking, and strong technical writing to remote roles in AI quality, data evaluation, and technical content review.
Experience
Work history, roles, and key accomplishments
Executed 200+ SxS/Likert assessments monthly across 5 platforms to support LLM refinement and validated 50+ AI reasoning traces weekly using JSON/YAML against safety and accuracy guidelines. Evaluated PT-PT content for cultural nuance and identified 30+ edge cases per week related to hallucinations, safety violations, and bias patterns, producing ground-truth justifications for retraining.
Executed 200+ SxS/Likert assessments monthly across 5 platforms to support LLM refinement and validated 50+ AI reasoning traces weekly using JSON/YAML against safety and accuracy guidelines. Evaluated PT-PT content for cultural nuance and identified 30+ edge cases per week related to hallucinations, safety violations, and bias patterns, producing ground-truth justifications for retraining.
AI Data Evaluator
DataAnnotation Tech
Jan 2025 - Present (1 year 3 months)
Executed 200+ SxS/Likert assessments monthly across 5 platforms to support LLM refinement and validated 50+ AI reasoning traces weekly using JSON/YAML against safety and accuracy guidelines. Evaluated PT-PT content for cultural nuance and identified 30+ edge cases per week related to hallucinations, safety violations, and bias patterns, producing ground-truth justifications for retraining.
Founder & Creative Director
Groovie Store
Jan 2022 - Jan 2024 (2 years)
Founded and led Groovie Store, managing product design, visual identity, and content strategy end-to-end for a fashion/e-commerce brand. Produced marketing assets and managed organic campaigns across Instagram, TikTok, and Pinterest, overseeing Etsy storefront operations and PT-PT/PT-BR localization.
Logistics & Data Coordinator
Inforlandia
Oct 2020 - Feb 2022 (1 year 4 months)
Maintained data integrity between inventory and ERP systems by implementing quality control protocols to identify and resolve discrepancies. Coordinated operational workflows to ensure accuracy under tight deadlines and produced technical documentation.
Education
Degrees, certifications, and relevant coursework
University of Lisbon (FLUL)
African Studies
2016 - 2019
Studied African Studies at the University of Lisbon (FLUL) from 2016 to 2019, including research methodologies and qualitative data analysis. Completed training in technical writing.
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring André?
You can contact André and 90k+ other talented remote workers on Himalayas.
Message AndréFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
