I’m looking for remote freelance, contract or permanent roles in LLM evaluation, multilingual AI evaluation, AI data quality, data annotation, language quality and content QA. I’m also open to taxonomy and metadata roles where my classification and data quality experience is transferable.

Carles Rodríguez
@carlesrodriguez
Multilingual AI evaluator with experience in LLM assessment, data quality, linguistic annotation and content QA across ES/CA/EN.
What I'm looking for
At Barcelona Supercomputing Center, I worked as a Research Engineer on structured evaluation and annotation of language models. I applied evaluation rubrics and scoring criteria across approximately 2,000 evaluations, covering 11 task types and 23 evaluation dimensions. I also worked on multilingual and linguistic annotation, including large-scale annotation of Catalan idiomatic expressions across central, Valencian, Balearic and north-western varieties.
My work also included multilingual text and audio tasks in English, Spanish and Catalan, including translation of strings and texts, audio annotation, audio-text validation and sentiment/emotion annotation.
At Thoth AI and Outlier, I evaluated AI-generated content in Spanish and English, focusing on instruction following, semantic accuracy, logical coherence, data labeling and calibration. I also provided structured feedback on task design, prompts and evaluation criteria.
Earlier in my career, I spent four years working in Trust & Safety and content moderation, applying platform policies to high-volume and ambiguous content and collaborating with quality teams on calibration and workflow improvements.
I’m a native Spanish speaker and native/bilingual Catalan speaker, with professional English (C1). I am based in Spain and available for remote freelance, contractor or permanent roles in AI evaluation, language quality, data quality, content QA and related areas.
Experience
Work history, roles, and key accomplishments
Designed and applied a LLM-as-a-Judge evaluation framework covering 11 task types and 23 evaluation
dimensions across ~2,000 annotated outputs.
Key areas:
- Preference ranking & response classification:
annotated LLM outputs using dual-axis evaluation
(harmlessness / helpfulness), categorical and
binary labeling, structured guideline frameworks.
- Multilingual NLP annotation: 1,000+ i
Evaluated AI-generated outputs for instruction-following adherence, semantic accuracy, and logical coherence across large-scale annotation workflows in Spanish and English.
Use the expertise to provide the PM team with suggestions in terms of language with the internal team or client's side to align on policy understandings. Help analyze quality issues and assist PM to resolve those issues. Calib
Participated in calibration sessions to align evaluation criteria across distributed teams. Contributed qualitative feedback to improve task design, prompt structure, and evaluation logic.
-Analyse data to identify and correct inaccuracies and inconsistencies in AI-generated texts and audios.
-Performing tasks of linguistic modelling, gradation, labelling and classification of data.
-Testing and
-Analyse data and identify inaccuracies and inconsistencies in the source to amend transcripts.
-Transcription, linguistic modeling, grading, data labeling and data classification.
-Assisting in language modelling test features
-Ensure accuracy of content through careful review and fact checking.
-Attention to detail in the completion of tasks.
-Ability to work in dynamic environments.
-Ability to work independently and as part of a team.
-Edited together video, audio still imagery and motion graphics for creative and informational multimedia projects with OTT environment.
-Delivered edits on time for reviews and final delivery.
-Created and updated records and files to maintain document compliance.
-Remained solutions-oriented in face of complex problems to assist management and overall business direction.
-Coached employees throu
-Enforcing customer community guidelines to protect users against thousands of attacks, including bullying, hate speech, violence and incitement, sexual solicitation, graphic content and many more.
-Increase company output by working on marketed queues and implementing alignments designated by the quality team.
- Review and screen reported social media.
- Participate in internal/external training
Manager/Content creator
Cuba Adhoc SLU
Mar 2015 - Jan 2019 (3 years 10 months)
Promotion and sale of tourism products and services on the island of Cuba via the Internet through the website www.touchcuba.net.
Brand development, increased website traffic, web user interface and advertising revenue.
Realization and confirmation of reservations with the different suppliers located in Cuba.
Establishment of the payment mode of the accommodation via Internet.
Recommendations
Coordinator and English teacher from Junior to Intermediate.
Performing tasks of Community Manager and Content Manager in addition to publishing content weekly related to English and with the school on Yes Si Terrassa's Facebook page.
Producer / Representative
LCA Producciones audiovisuales
Apr 2012 - Sep 2014 (2 years 5 months)
Representation with the director of the firm in audiovisual events in Cuba. Negotiation of contracts with clients in various fields, both at the corporate level in the realization of marketing spots as well as with musicians and artists. As producer, administrative and legal organization of audiovisual productions; management and budget breakdown, recruitment of staff and supervision of the shooti
Research associate
EGREM
Sep 2010 - May 2012 (1 year 8 months)
Assistance and mentoring of newly licensed social scientists in their first research projects.
Participation in the supervision of multidisciplinary research groups on an individual basis and on a monthly basis.
Maintenance of research files in accordance with company policies and procedures.
Editing of reports and research proposals aimed at improving the quality of the projects being carried
Musical Director
Allegro Teatro
Jan 2011 - Mar 2012 (1 year 2 months)
Adaptation and composition of musical pieces to achieve a certain musical style adapted to each play. Composition, adaptation and recording of more than 15 original songs.
Promotion of events and performances by participating in interviews in the media in Santiago de Cuba. Participation in the national tour of Allegro Teatro in Cuba, acting in Havana, Holguín and Santiago de Cuba.
Collaboration w
Associated Researcher
ECME Miguel Matamoros
Jul 2009 - Jul 2010 (1 year)
Attendance at meetings, training sessions and conferences related to training methods for new
sociologists and musicologists.
Review of the weekly progress of the investigations and the production of summaries.
Collaboration with other researchers in multidisciplinary research.
Preparation and exhibition of investigative panels in the framework of conferences related to music and
musical culture i
Education
Degrees, certifications, and relevant coursework
Amazon Web Services (AWS)
Certificaciones AWS
Feb 2026
Universidad de La Rioja
Recovery Augmented Generation (RAG): theory and applications
2025 - 2025
I recently completed an introductory course on Retrieval-Augmented Generation (RAG), learning how to enhance Large Language Models (LLMs) by connecting them to external knowledge sources. The course covered RAG’s core architecture (retrieval + generation), its ability to mitigate LLM limitations like hallucinations or static memory, and typical use cases such as QA systems, semantic search, and do
Universidad de La Rioja
Procesamiento de Lenguaje Natural con Python: fundamentos, bibliotecas y aplicaciones
2025 - 2025
Contenidos:
Introducción al Procesamiento de Lenguaje Natural (PLN) y herramientas en Python
Tokenization, lematización y stemming
Representaciones semánticas del lenguaje
Aplicaciones prácticas del PLN
Personalización de pipelines y componentes
Universidad de Oriente. Cuba
Postgraduate studies in Social Communication, Advertising and New Media, Sociology
2009 - 2010
Universidad de Oriente. Cuba
Sociology, Sociología de la Comunicación, Sociología de la Salud, Sociología de la Cultura, Antropología
2004 - 2009
June 2009: Presentation of the thesis "Effects of foreign television broadcasts on the youngsters of Abel Sta. Maria neighborhood", with an excellent rating.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Job categories
Interested in hiring Carles?
You can contact Carles and 90k+ other talented remote workers on Himalayas.
Message CarlesGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
