Ankur Roy
@ankurroy
I evaluate and train LLMs through RLHF, multi-turn reasoning critique, and rigorous factuality verification.
IndiaWhat I'm looking for
I've evaluated and trained LLM responses for Outlier.ai, ranking multi-turn outputs for truthfulness, instruction adherence, conciseness, and tone. I write detailed rationales that identify logical fallacies, rubric violations, mathematical inaccuracies, and hallucinations while sustaining a 95%+ quality audit rating.
Across Atlas Data Annotation and Remotasks, I've labeled dialogue data, audited conversational context, evaluated chain-of-thought outputs, and conducted side-by-side preference evaluations. I bring engineering rigor, structured critical thinking, and high-velocity fact-checking to improving generative AI training data.
Experience
Work history, roles, and key accomplishments
Evaluate, rank, and rate multi-turn LLM candidate responses across truthfulness, instruction adherence, conciseness, and tone. Author justification rationales and conduct source-level verification to detect hallucinations.
Data Annotation Specialist
Atlas Data Annotation Project
Jan 2023 - Dec 2024 (1 year 11 months)
Executed fine-grained intent classification, conversational context auditing, and multi-turn dialogue labeling to refine NLU training sets. Evaluated Chain-of-Thought outputs and collaborated with QA reviewers to standardize scoring rubrics.
Mastered extensive dynamic guidelines to deliver high-throughput text evaluation and taxonomy classification. Performed side-by-side preference evaluations to align AI outputs with safety and helpfulness policies.
Education
Degrees, certifications, and relevant coursework
Heritage Institute of Technology
B.Tech, Civil Engineering
Graduated with a B.Tech in Civil Engineering in 2025.
Availability
Location
IndiaAuthorized to work in
Salary expectations
Social media
Skills
Interested in hiring Ankur?
You can contact Ankur and 90k+ other talented remote workers on Himalayas.
Message AnkurGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
