Skip to main content
AK
Open to opportunities

Aleksei khvostov

@alekseikhvostov

AI Safety & LLM Evaluation | Agentic AI Governance | Red Teaming | Structured Evaluation Methods

United States
Message

I am an AI Safety and LLM Evaluation specialist with experience in adversarial testing, prompt evaluation, structured QA workflows, Criterion-Based Verification (CBV), and GenAI safety assessment. My work focuses on evaluating model behavior under ambiguous, adversarial, high-risk, and multi-turn scenarios — including prompt injection, hallucination detection, dual-use calibration, deceptive compliance, and context escalation. My current focus is agentic AI safety: how risks change when LLMs start planning, delegating, using tools, interacting with other agents, and operating across longer task horizons. I see agentic systems as one of the sharpest current frontiers in AI safety because failures can emerge from interaction patterns, not just single outputs.

Experience

Work history, roles, and key accomplishments

OU
Current

AI Content Reviewer & Prompt Evaluator

Outlier.ai

Jan 2025 - Present (1 year 5 months)

Reviewed and evaluated AI-generated outputs, including potentially sensitive or harmful content, to ensure alignment with trust and safety guidelines. Assessed prompt quality and model behavior for safety, bias, misinformation, and factual inaccuracy across multiple annotation platforms.

TC
Current

Volunteer Tutor

The Shepherd's Church

Jun 2024 - Present (2 years)

Assisted students in Special Needs Ministry programs, offering personalized support to accommodate diverse learning abilities and needs. Provided individualized instruction and support to students in ESL classes, helping them develop language skills and adjust to the learning environment.

PA

Managing Editor

PRIME Business News Agency

Mar 2023 - Jul 2023 (4 months)

Led a team of 15 specialists in delivering accurate and timely financial news, leveraging analytical tools to inform editorial decisions. Translated complex economic and financial reports with advanced proficiency in Russian and English legal and financial terminology.

RC

Lead Editor

Rambler & Co

Jul 2020 - Dec 2022 (2 years 5 months)

Led and managed a large team (40+ members) of diverse specialists in the production of complex informational materials related to culture, history, entertainment, economy, and global affairs. Developed editorial standards and guidelines, adapting them in response to changing media regulations.

LE

Senior Editor | Director of Breaking News

Lenta.ru

May 2012 - Jul 2020 (8 years 2 months)

Designed and delivered ongoing training for editorial staff on investigative reporting, analytical research, and journalistic ethics. Led the analysis of legislative texts, budget documents, and financial reports to ensure the accuracy and relevance of the newsroom's political and economic coverage.

Education

Degrees, certifications, and relevant coursework

MU

Moscow Pedagogical State University

Master of Arts, History

Completed a Master of Arts in History, focusing on historical research and pedagogical methods. Developed strong analytical and critical thinking skills essential for academic and professional pursuits.

Tech stack

Software and tools used professionally

Find your dream job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan