Skip to main content
Deva AshokDA
Looking for a job

Deva Ashok

@devaashok

AI/LLM evaluator at Innodata who assessed business-agent responses for faithfulness, compliance, relevance and task completion.

India
Message

What I'm looking for

I'm seeking an AI, data quality or LLM evaluation role.

At Innodata India Pvt. Ltd., I evaluated multi-turn conversations from an AI business agent against its knowledge base, FAQs, ad context and owner instructions.

I assessed action fidelity, faithfulness, hallucinations and instruction hierarchy, while also reviewing tone, formatting and tool-call handling. I wrote evidence-based justifications for each rating and applied guideline updates and lead rulings consistently.

As a freelance AI Data Evaluator for Welo Data’s Ask Maps Personalization project, I evaluated map queries and results for relevance, intent and contextual accuracy. I also performed structured data evaluation against project guidelines.

I'm currently transcribing Tamil audio for TSMG Platform, following project guidelines and tag sheets. My background also includes teaching, donor relations, and an M.Sc. in Applicable Mathematics.

Experience

Work history, roles, and key accomplishments

TP
Current

Freelance Tamil Audio Transcriptionist

TSMG Platform

Oct 2026 - Present (1 month)

Transcribed Tamil audio accurately, following project guidelines and tag sheets. Applied tags consistently and maintained quality across tasks.

Tamil Audio Transcription Specialist
Tag Sheet Annotation
Data Annotation
Attention To Detail
IL

Analyst – AI/LLM Practice

Innodata India Pvt. Ltd.

Sep 2026 - Oct 2026 (1 month)

Evaluated multi-turn conversations of an AI business agent, rating responses against business knowledge base, FAQs, and instructions. Assessed action fidelity, faithfulness, hallucination, compliance, and relevance, and wrote evidence-based justifications.

LLM Response Evaluation
Hallucination Factuality Checks
Instruction Following Assessment
Guideline ComplianceSearch RelevanceData Annotation
WD

Freelance AI Data Evaluator – Ask Maps Personalization

Welo Data

Sep 2026 - Sep 2026 (0 months)

Evaluated map queries and results for relevance, query intent, and contextual accuracy. Performed structured data evaluation against project guidelines.

Search RelevanceSearch Intent Analysis
Maps Evaluation
Personalization Evaluation
Data Annotation

Education

Degrees, certifications, and relevant coursework

SW

SDNB Vaishnav College for Women

M.Sc., Applicable Mathematics

Grade: 84%

Completed M.Sc. in Applicable Mathematics with 84%.

SW

SDNB Vaishnav College for Women

Master of Science, Applicable Mathematics

Grade: 84%

Completed M.Sc. in Applicable Mathematics with 84%.

SW

SDNB Vaishnav College for Women

B.Sc., Mathematics

Grade: 78%

Completed B.Sc. in Mathematics with 78%.

SW

SDNB Vaishnav College for Women

Bachelor of Science, Mathematics

Grade: 78%

Completed B.Sc. in Mathematics with 78%.

SN

Swayam NPTEL

Certification, Graph Theory

Completed a certification course in Graph Theory.

GL

Great Learning

Certification, MS Excel

Completed a certification course in Basics of MS Excel.

Tech stack

Software and tools used professionally

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

550k+ INR

Skills

LLM Response EvaluationHallucination Detection
Faithfulness
Instruction Following Assessment
Guideline ComplianceSearch RelevanceSearch Intent Analysis
Maps Evaluation
Personalization Evaluation
Tamil Audio Transcription Specialist
Tag Sheet Annotation
Data AnnotationPrompt WritingExcelMicrosoft WordPythonC

Interested in hiring Deva?

You can contact Deva and 600K+ other talented remote workers on Himalayas.

Message Deva

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan