Mattia Lieciani
@mattialieciani
AI QA Lead at Pareto.AI, where I reviewed 3,200+ tasks and defined deterministic checks for reliable LLM and agentic AI evaluation.
PhilippinesWhat I'm looking for
At Pareto.AI, I QA 3,200+ tasks across Excel and Python, spreadsheet, agentic AI, and computer-use evaluation, with a 98% approval rate on reviewed work. I also defined deterministic correctness checks for Excel-from-broken-input tasks.
I authored the Python-task worker guideline used to onboard and standardize the team, and served as a second-layer reviewer and calibrator for four reviewers to reduce drift across high-volume batches.
At Invisible, I trained and evaluated LLMs using Reinforcement Learning with Human Feedback and Supervised Fine-Tuning, and reviewed training batches for data quality. At Fyxer AI, I annotated more than 1,000 rows of meeting-transcript data and ran QC reviews on every batch.
I specialize in making AI evaluation results reliable, consistent, and verifiable. I’m particularly interested in remote AI Quality Assurance, Evaluation Specialist, and QA Lead opportunities, and collaborations involving evaluation reliability and workflow automation.
Experience
Work history, roles, and key accomplishments
- QA'd 3,200+ tasks across 8 projects (Excel/Python, spreadsheet, agentic and computer-use evaluation) with a 98% approval rate on reviewed work.
- Led QA on Excel-from-broken-input tasks, defining deterministic correctness checks for high-confidence approve/reject decisions.
- Authored the Python-task worker guideline used by management to onboard and standardize the team.
- Second-layer reviewer
- Annotated 1,000+ rows of meeting-transcript data in Excel under project-specific guidelines.
- Ran QC reviews on every batch to catch inconsistencies and protect data integrity.
- Fed annotation-criteria improvements back to data scientists and project managers.
• Applied automated data recognition algorithms to identify Personally Identifiable Information (PII) for compliance with data privacy standards.
• Provided manual oversight for edge cases to ensure accurate labeling of PII.
QA/QC
Invisible
May 2024 - Jun 2025 (1 year 1 month)
Worked as QA/QC at Invisible.
Advanced AI Data Trainer
Invisible
Apr 2024 - Jun 2025 (1 year 2 months)
As an Advanced AI Data Trainer at Invisible, I led initiatives to refine AI accuracy by employing Reinforcement Learning with Human Feedback (RLHF) and Supervised Fine-Tuning (SFT) techniques for optimal performance. Trained and evaluated LLMs using RLHF and Supervised Fine-Tuning, refining model accuracy through structured human feedback. Ran QA/QC reviews on training batches to maintain data qua
Office Manager
PP Construction BV
Aug 2021 - May 2022 (9 months)
• Managed fiscal operations for concrete pavements projects, overseeing budgeting and financial reporting.
• Organized calendars for 10+ employees, optimizing scheduling efficiency.
• Represented company in fiscal matters, effectively communicating with clients and stakeholders.
Executive chef
Loccos Pizzabar
Dec 2018 - Dec 2019 (1 year)
• Directed and managed culinary operations at Loccos Pizzabar, ensuring impeccable food quality and kitchen efficiency.
• Led a team of 9 professionals to deliver service excellence in the kitchen and pizzeria divisions.
Chemical Laboratory Tester
allnex
Apr 2018 - Nov 2018 (7 months)
• Operated chemical reactors at Allnex, ensuring product quality and safety through laboratory control measures.
• Oversaw production processes to maintain efficiency and consistency in product output.
• Collaborated with team members to troubleshoot issues and optimize reactor performance.
• Implemented safety protocols to ensure a secure working environment.
Assistant Hotel Manager
Alla Favorita
Aug 2017 - Feb 2018 (6 months)
As an integral part of the management team at Alla Favorita Hotel, I served as the Assistant Manager, contributing to the smooth and efficient operation of the hotel's daily functions while ensuring an exceptional guest experience.
Head Chef
Trattoria Casetta Rossa
Aug 2016 - Jun 2017 (10 months)
As the Head Chef at Trattoria Casetta Rossa, I led and managed the culinary operations of both the kitchen and pizzeria, overseeing a team of three dedicated professionals. In this role, I was responsible for maintaining high standards of food quality, service, and kitchen efficiency.
Food Production Specialist
Sintal Dietetics Srl
Jun 2015 - Aug 2016 (1 year 2 months)
As a skilled worker at Animal Nutrition Specialists, I played a pivotal role in the meticulous preparation of both chemical and natural microencapsulated food tailored for animals. Collaborating closely with a team of two colleagues, I contributed expertise and dedication to ensure the production of high-quality specialized animal nutrition products.
Head Chef
New Red House
Jan 2007 - Jan 2015 (8 years)
Worked as Head Chef at New Red House.
Education
Degrees, certifications, and relevant coursework
EF SET
EF SET English Certificate C2 Proficient
Apr 2025
Project Initiation: Starting a Successful Project
Nov 2024
IBM
Data Visualization and Dashboards with Excel and Cognos
Aug 2024
Coursera
Data Analysis with Python
Aug 2024
Coursera Project Network
Build an Automated Landing page using AI from Wix ADI
Apr 2024
Coursera
Excel Essentials for Data Analytics
Aug 2024
IBM
Generative AI: Enhance your Data Analytics Career
Aug 2024
IBM
IBM Data Analyst Specialization
Aug 2024
Google Cloud
Introduction to Responsible AI
Apr 2024
Coursera Project Network
ChatGPT for Beginners: SciFi Writing with Dall-e
Apr 2024
Ethics in the Age of Generative AI
Apr 2024
Foundations of Responsible AI
Apr 2024
Google Cloud
Introduction to Generative AI Studio
Apr 2024
Google Cloud
Introduction to Large Language Models
Apr 2024
The State of AI and Copyright
Apr 2024
Responsible AI Foundations
Apr 2024
Google Cloud
Summarize Text using SQL and LLMs in BigQuery ML
Apr 2024
Coursera
Google Digital Marketing & E-commerce Certificate
Dec 2023
I.T.Ag. Trentin
High School Diploma, Agricultural and Food Products Processing
2000 - 2005
Tech stack
Software and tools used professionally
Availability
Location
PhilippinesAuthorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Mattia?
You can contact Mattia and 90k+ other talented remote workers on Himalayas.
Message MattiaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
