Looking for a job

heeba User

@heebauser

Message

AI Data Annotation Specialist at Innodata who evaluates LLM text and audio outputs and creates annotation guidelines.

India

Message

At Innodata Inc., I review LLM training data and evaluate model outputs for accuracy, instruction adherence, tone, and policy compliance. I also review audio and speech evaluations, including transcription accuracy and voice-model output quality.

I create annotation guidelines and rubrics from client requirements, then prepare and conduct calibration calls to align reviewers on edge cases. After joining as an AI Data Annotator & Reviewer, I was promoted to Quality & Policy Expert within three months.

Experience

Work history, roles, and key accomplishments

Quality & Policy Expert (QPE), LLM Practice

Innodata Inc.

Oct 2024 - Oct 2026 (2 years)

Reviews and quality-checks LLM training data for enterprise clients, evaluates model outputs for accuracy and policy compliance, and creates guidelines and rubrics. Conducts calibration calls, supports inter-annotator agreement, and provides feedback to annotators.

LLM Evaluation Quality Assurance Content Policy Safety Classification Harm Taxonomy Red Teaming Bias Detection Toxicity and Safety Review Guideline And Checklist Creation Call Calibration Inter Annotator Agreement Microsoft Word Excel

AI Data Annotator & Reviewer

Innodata Inc.

Jul 2024 - Oct 2024 (3 months)

Annotated and reviewed text and audio datasets for SFT and RLHF pipelines, including preference ranking, classification, and span labeling. Evaluated model responses and maintained throughput and accuracy during production sprints.

Data Annotation SFT RLHF Preference Ranking Text Classification Span Labeling NER Sentiment Analysis Audio Evaluation Transcription Review Quality Control

Customer Service Executive

Greater Pharma

Jun 2023 - Jun 2024 (1 year)

Handled inbound queries from business partners and distributors via email and phone, coordinated with internal teams to resolve order and delivery issues, and maintained accurate records.

Customer Service Query Resolution Complaint Handling Email Communication Phone Support Excel Microsoft Word

Talent Acquisition Specialist

Conglomerate IT

Feb 2023 - Jun 2023 (4 months)

Supported end-to-end recruitment for technical and non-technical roles, including sourcing, screening, and interview coordination, and maintained candidate pipelines in ATS.

Recruitment Sourcing Screening Interview Coordination ATS Candidate Pipeline Management