Himalayas logo
austen barnetteAB
Open to opportunities

austen barnette

@austenbarnette

Analytical AI systems evaluator specializing in agent behavior assessment and ethical, structured problem-solving.

Canada
Message

What I'm looking for

I seek remote, flexible roles assessing AI systems where I can apply structured evaluation, ethical oversight, and collaborative research to improve model reliability.

I am an analytical AI systems evaluation professional with a strong foundation in research, systems thinking, and critical reasoning. I specialize in assessing AI-driven tasks, spotting logical errors, and improving frameworks for agent evaluation.

As a freelance AI Systems Evaluation Analyst since January 2023, I evaluate agent behaviors and test-case structures for consistency, realism, and completeness, defining gold-standard responses and performance benchmarks. Previously, as a Research & Data Analyst (Mar 2020–Dec 2022), I conducted qualitative and quantitative research to support AI data annotation, logic validation, and scenario-based evaluation.

My work emphasizes consistency, accuracy, and fairness in data labeling and model output assessment, applying systemic reasoning to identify trends and outliers in large datasets. I collaborate with data scientists and cross-functional teams to improve AI model performance and evaluation rigor.

I am passionate about ethical AI development and clear, structured problem-solving in remote, flexible environments, and I bring strong critical thinking and remote collaboration experience to roles focused on trustworthy AI evaluation.

Experience

Work history, roles, and key accomplishments

FR
Current

AI Systems Evaluation Analyst

Freelance

Jan 2023 - Present (2 years 11 months)

Evaluate AI agent behaviors and test-case structures for logical consistency, identify missing assumptions and contradictions, and define gold-standard responses and benchmarks to ensure reliable agent evaluation.

RE

Research & Data Analyst

Remote

Mar 2020 - Dec 2022 (2 years 9 months)

Conducted qualitative and quantitative research to support AI data annotation and logic validation, collaborated with data scientists to improve model outputs, and ensured consistency and fairness in labeling across large datasets.

Education

Degrees, certifications, and relevant coursework

University of Toronto logoUT

University of Toronto

Bachelor of Science, Cognitive Science

2016 - 2019

Completed a Bachelor of Science in Cognitive Science with coursework in systems thinking, logic and reasoning, human-AI interaction, and information processing.

Tech stack

Software and tools used professionally

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
austen barnette - AI Systems Evaluation Analyst - Freelance | Himalayas