Maria Andrea Maggi
@mariaandreamaggi
AI Trainer and LLM evaluation specialist improving GenAI quality with RLHF and human feedback.
What I'm looking for
I’m an AI Trainer and LLM Evaluation Specialist with hands-on experience improving Large Language Models through Reinforcement Learning from Human Feedback (RLHF). I evaluate AI-generated responses using clear methodologies, structured feedback, and strict quality guidelines.
In fully remote international environments, I rank and compare LLM outputs through side-by-side evaluation. I assess instruction following, factual accuracy, reasoning quality, and safety, then provide detailed written justifications to support better production AI systems.
I also work across AI data annotation and content quality assessment, including prompt analysis, language evaluation, guideline compliance, AI output validation, and response ranking. My focus is on delivering consistent, reliable quality judgments that strengthen trust & safety and user outcomes.
Beyond my current AI work, I bring a strong operations mindset from earlier roles involving quality assurance, customer service, and administrative support. I’m passionate about Machine Learning, Generative AI, and AI Operations, and I continue building my foundation through certifications in progress.
Experience
Work history, roles, and key accomplishments
Perform AI data annotation for RLHF/LLM evaluation, including prompt analysis, language evaluation, and content quality assessment. Apply prompt engineering and guideline compliance, validate AI outputs, and complete Italian and English evaluation tasks.
AI Trainer & LLM Evaluation
Invisible Technologies
Apr 2026 - Present (4 months)
Evaluate AI-generated responses using RLHF methodologies, including side-by-side ranking and assessment of instruction following, factual accuracy, reasoning quality, and safety. Provide detailed written justifications while working independently under strict quality guidelines.
Conduct human preference evaluation and search quality rating, including content quality review and fact checking. Evaluate user intent and relevance, perform data labeling and verification, and apply trust & safety quality assurance.
Education
Degrees, certifications, and relevant coursework
Maria Andrea hasn't added their education
Don't worry, there are 90k+ talented remote workers on Himalayas
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Skills
Interested in hiring Maria Andrea?
You can contact Maria Andrea and 90k+ other talented remote workers on Himalayas.
Message Maria AndreaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
