Skip to main content
Alyssa LianaAL
Looking for a job

Alyssa Liana

@alyssaliana

AI evaluator at Outlier AI auditing LLM agent failures and shaping reproducible evaluation benchmarks.

United States
Message

At Outlier AI, I audit and rank complex LLM outputs against rubrics for reasoning, safety, and goal compliance. I document agent failure modes and design error-classification taxonomies for model alignment and benchmarking.

At the University of Alaska, I develop reproducible Python pipelines to simulate multi-turn, goal-oriented web browsing. I compare synthetic clickstream patterns with real-world user interaction traces.

I also conduct significance testing and ablation studies to examine how prompt variations and context constraints affect model behavior.

Earlier, as a Research & Academic Content Assistant at University of Alaska Anchorage, I synthesized qualitative evaluation reports and checked research data against original empirical sources. My Ph.D. work focuses on simulated user exploration and behavioral calibration in autonomous web agents.

Experience

Work history, roles, and key accomplishments

OA
Current

Quality Assurance Evaluator & AI Research Specialist

Outlier AI

Jan 2025 - Present (1 year 8 months)

Audit, evaluate, and rank complex LLM outputs based on strict rubrics for reasoning, safety, and goal compliance. Identify and document failure modes, including hallucinations, tool execution loops, and logical fallacies in multi-step agent trajectories.

UA

Research & Academic Content Assistant

University of Alaska Anchorage

Sep 2023 - May 2024 (8 months)

Synthesized qualitative evaluation reports for department manuscripts and research datasets. Maintained database integrity by cross-referencing qualitative data entries against original empirical source documents.

Education

Degrees, certifications, and relevant coursework

UA

University of Alaska

Ph.D., Computer Science / Human-Computer Interaction

Pursuing a Ph.D. in Computer Science with a focus on Human-Computer Interaction, expected graduation in May 2028.

UA

University of Alaska Anchorage

Master of Arts, Philosophy

Completed a Master of Arts in Philosophy with a focus on Cognition and Logic in May 2024.

UF

University of Alaska Fairbanks

Bachelor of Arts, Philosophy

Completed a Bachelor of Arts in Philosophy in May 2022.

CP

CITI Program

Ethical Research & Data Evaluation (CITI Program Certified), Research Ethics

Certification in Ethical Research and Data Evaluation, Social & Behavioral Modules.

QI

QSR International

Advanced Quality & Qualitative Analysis Certification, Qualitative Analysis

Certification in Advanced Quality and Qualitative Analysis.

Interested in hiring Alyssa?

You can contact Alyssa and 90k+ other talented remote workers on Himalayas.

Message Alyssa

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan