Xrs Here
@sumanmahato
AI output evaluation and data annotation-focused CS graduate, skilled in rubric-based LLM quality assessment.
What I'm looking for
I’m a B.Tech Computer Science & Engineering graduate (Heritage Institute of Technology, 2026) with focused experience in AI output evaluation, data annotation, and model quality assessment. I evaluate LLM responses across text generation, reasoning, summarization, coding, and instruction-following tasks with strong written English and high attention to detail.
From 2024–2026, I completed independent AI output evaluation and data annotation work where I evaluated 500+ LLM-generated responses using structured quality rubrics. I performed side-by-side (SxS) response comparisons, ranking outputs for safety, relevance, tone, and helpfulness—directly aligned with RLHF workflows. I also annotated and labeled training data across multiple task types while maintaining consistent guideline adherence across evaluation batches.
I’m especially careful about model reliability: I identified model failure modes like hallucination, reasoning gaps, and instruction drift, then documented findings clearly for review. Alongside evaluation, I’ve built a machine learning prediction pipeline with Scikit-learn and Pandas, and completed text analysis/NLP experiments using NLTK and Regex—plus multiple Python applications emphasizing OOP, modular design, error handling, and readable documentation.
Experience
Work history, roles, and key accomplishments
AI Output Evaluation & Data Annotation
Heritage Institute of Technology
Jan 2024 - Jan 2026 (2 years)
Evaluated 500+ LLM-generated responses across text generation, reasoning, summarization, and instruction-following using structured quality rubrics. Performed side-by-side response comparisons and training data annotation aligned with RLHF-style quality feedback.
Education
Degrees, certifications, and relevant coursework
Heritage Institute of Technology
Bachelor of Technology (B.Tech), Computer Science & Engineering
B.Tech in Computer Science & Engineering, graduating in 2026. Coursework includes data structures and algorithms, DBMS, machine learning, natural language processing, and computer networks.
Availability
Location
Authorized to work in
Portfolio
github.com/sumanherJob categories
Skills
Interested in hiring Xrs?
You can contact Xrs and 90k+ other talented remote workers on Himalayas.
Message XrsGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
