Skip to main content
Sriram RameshSR
Open to opportunities

Sriram Ramesh

@sriramramesh

I evaluate LLM and multimodal outputs for quality, safety, and instruction adherence, improving datasets and localized user experiences.

India
Message

What I'm looking for

I’m looking for an AI evaluation and quality-focused role where I can benchmark LLMs and multimodal datasets for safety, accuracy, and localization quality—using structured rubrics, clear rationales, and continuous improvement.

I’m an AI Data Annotator and LLM Quality Analyst focused on large language model evaluation and multimodal dataset validation. I benchmark model outputs for truthfulness, helpfulness, factual accuracy, safety, and instruction adherence, using structured, rationale-driven QA.

In my current Data Annotator role, I perform image and video annotation with detailed visual descriptions, frame transformation analysis, and entity tagging. I create and refine bounding boxes to improve computer vision dataset accuracy, and I review transcription accuracy to strengthen quality assurance.

I also evaluate LLM outputs across empathy, verbosity, contextual relevance, and PII compliance, and I simulate AI chat interactions involving text, image, and video generation tasks. By comparing multiple model outputs and documenting structured evaluation rationales, I help drive clearer training feedback and support reinforcement learning workflows.

As a bilingual expert (English–Tamil), I simulate real-time conversational scenarios using two Gemini model variants and benchmark results with evaluation rubrics. I translate and localize content, assess cultural appropriateness and semantic similarity, and recommend updates that improve the Tamil locale experience.

Experience

Work history, roles, and key accomplishments

DA
Current

Bilingual Expert

DataAnnotation.tech

Mar 2025 - Present (1 year 3 months)

Simulated real-time bilingual conversational scenarios and benchmarked Gemini model variants using structured evaluation rubrics with documented rationales. Translated and localized English–Tamil content, assessed cultural appropriateness and semantic similarity, and recommended updates to improve Tamil user experience.

II
Current

Data Annotator

Innodata Inc

May 2024 - Present (2 years 1 month)

Performed image and video annotation (bounding boxes, frame transformation analysis, and inpainting instructions) to improve computer vision dataset quality. Evaluated LLM outputs for instruction adherence, factual accuracy, helpfulness, safety, empathy/verbosity, and PII compliance, and documented structured evaluation rationales.

Education

Degrees, certifications, and relevant coursework

University of Madras logoUM

University of Madras

Bachelor of Commerce, Accounting and Finance

2022 - 2025

Grade: CGPA 8.3/10

Studied Bachelor of Commerce in Accounting and Finance at the University of Madras from 2022 to 2025, achieving a CGPA of 8.3/10.

Tech stack

Software and tools used professionally

Find your dream job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan