austen barnette
@austenbarnette
Analytical AI systems evaluator specializing in agent behavior assessment and ethical, structured problem-solving.
What I'm looking for
I am an analytical AI systems evaluation professional with a strong foundation in research, systems thinking, and critical reasoning. I specialize in assessing AI-driven tasks, spotting logical errors, and improving frameworks for agent evaluation.
As a freelance AI Systems Evaluation Analyst since January 2023, I evaluate agent behaviors and test-case structures for consistency, realism, and completeness, defining gold-standard responses and performance benchmarks. Previously, as a Research & Data Analyst (Mar 2020–Dec 2022), I conducted qualitative and quantitative research to support AI data annotation, logic validation, and scenario-based evaluation.
My work emphasizes consistency, accuracy, and fairness in data labeling and model output assessment, applying systemic reasoning to identify trends and outliers in large datasets. I collaborate with data scientists and cross-functional teams to improve AI model performance and evaluation rigor.
I am passionate about ethical AI development and clear, structured problem-solving in remote, flexible environments, and I bring strong critical thinking and remote collaboration experience to roles focused on trustworthy AI evaluation.
Experience
Work history, roles, and key accomplishments
AI Systems Evaluation Analyst
Freelance
Jan 2023 - Present (2 years 11 months)
Evaluate AI agent behaviors and test-case structures for logical consistency, identify missing assumptions and contradictions, and define gold-standard responses and benchmarks to ensure reliable agent evaluation.
Research & Data Analyst
Remote
Mar 2020 - Dec 2022 (2 years 9 months)
Conducted qualitative and quantitative research to support AI data annotation and logic validation, collaborated with data scientists to improve model outputs, and ensured consistency and fairness in labeling across large datasets.
Education
Degrees, certifications, and relevant coursework
University of Toronto
Bachelor of Science, Cognitive Science
2016 - 2019
Completed a Bachelor of Science in Cognitive Science with coursework in systems thinking, logic and reasoning, human-AI interaction, and information processing.
Availability
Location
Authorized to work in
Job categories
Interested in hiring austen?
You can contact austen and 90k+ other talented remote workers on Himalayas.
Message austenFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
