Open to opportunities

Neyati Sood

@neyatisood

Message

AI/LLM Analyst specializing in prompt evaluation, rubric-based QA, and error analysis to improve training datasets.

India

Message

What I'm looking for

I’m looking for an AI/LLM evaluation role where I can run rubric-based QA, conduct error analysis, refine prompts, and improve training datasets with consistently high accuracy and guideline alignment.

I’m an AI/LLM Analyst focused on evaluation quality: I assess 500+ LLM outputs weekly for factual accuracy, coherence, and instruction adherence, and I maintain 95%+ QA accuracy across annotation and response validation pipelines.

My background combines applied economics and econometrics with hands-on evaluation work. I translate detailed evaluation guidelines into consistent, high-agreement labeling decisions at scale, using rubric-based scoring, inter-annotator agreement, and bias & safety review.

In practice, I run prompt refinement and error analysis on flagged outputs, identify recurring error patterns, and feed corrections back into review cycles to strengthen dataset reliability. I also support response ranking, RLHF data workflows, and multi-turn/chatbot evaluation through adversarial review and red teaming.

Experience

Work history, roles, and key accomplishments

Current

Analyst, AI/LLM Practice

Current

Innodata Inc.

Jan 2026 - Present (6 months)

Evaluate and annotate LLM outputs across 500+ prompts weekly, assessing factual accuracy, coherence, and instruction adherence to support model training pipelines. Maintain 95%+ QA accuracy, perform error analysis on flagged outputs, and apply prompt refinement to improve output quality and consistency.

LLM Output Evaluation Data Annotation QA Response Consistency

Freelance AI/LLM Analyst

Alignerr

Jan 2026 - Mar 2026 (2 months)

Complete weekly AI training tasks including response ranking, annotation, and comparative evaluation of outputs from multiple frontier LLMs. Assess responses for relevance, correctness, and alignment with user intent while following detailed guidelines across concurrent projects.

LLM Evaluation Response Ranking Comparative Assessments Data Annotation Relevance Assessment Correctness User Intent Quality Assurance

Research Assistant

Panjab University

Jun 2024 - Aug 2024 (2 months)

Analyzed financial performance of Indian public sector banks by evaluating multi-year trends in credit growth, NPAs, and key financial indicators using large datasets. Cleaned, processed, and visualized data in Excel to support the consultancy final report.

Data Cleaning Data Visualization Excel

National Seminar — CHASSCONG

Panjab University

Mar 2025 - Present (1 year 4 months)

Presented original research at a national-level seminar on human development in North-West India. Topic: "Skill Development Efforts in India: An Analysis of PMKVY in North Western States."

Research Presentation Data Analysis

Education

Degrees, certifications, and relevant coursework

Panjab University

Master of Arts in Economics, Economics

2023 - 2025

Grade: 70%

Activities and societies: Coursework: Econometrics, Applied Regression Analysis, Public Policy Analysis, Statistics, Research Methods.

Completed an M.A. in Economics at Panjab University (2023–2025), scoring 70%. Coursework included econometrics, applied regression analysis, public policy analysis, statistics, and research methods.