Looking for a job

Shivani Chaudhary

@shivanichaudhary1

Message

I audit AI speech and text outputs for quality, safety, and training-data reliability.

India

Message

What I'm looking for

I'm looking for remote contract or freelance AI evaluation, annotation, red-teaming, data quality, and speech or language assessment roles where I can improve model reliability and safety.

At RWS TrainAI, I audited human raters’ evaluations of competing AI models in a live RLHF pipeline, catching rating errors, guideline violations, and weak rationales before they entered training data. I evaluated speech and text for instruction following, factual accuracy, naturalness, fluency, accent authenticity, and audio quality.

My investigative journalism background strengthens my approach to hallucination detection, source verification, misinformation review, and evidence-based reporting. I work bilingually in Hindi and English and am seeking remote contract or freelance AI evaluation, annotation, red-teaming, and data-quality work.

Experience

Work history, roles, and key accomplishments

Current

Freelance Investigative Journalist

Current

Self-Employed

Jan 2023 - Present (3 years 8 months)

Applied advanced fact-checking, source verification, and logical analysis to complex multi-source investigations. Evaluated information quality and coherence across large volumes of data, producing detailed analytical reports.

Fact Checking Source verification Logic and Analysis Investigative Research Report Writing Data Analysis

AI Quality Assurance Auditor

RWS TrainAI

Jul 2026 - Aug 2026 (1 month)

Served as second-level QA reviewer in a live RLHF pipeline, auditing human raters' evaluations of AI-generated speech and text. Evaluated speech naturalness, prosody, and audio quality, and validated rationales for consistency and alignment with ratings.

LLM Evaluation RLHF QA auditing Speech Evaluation TTS Assessment Naturalness Evaluation Rationale Validation Rubric Application Data Integrity Structured Feedback

Investigative Journalism Fellow

National Foundation for India

Jan 2022 - Jan 2023 (1 year)

Conducted rigorous field research, evidence collection, and qualitative analysis across high-complexity investigations. Produced detailed structured reports ensuring accuracy and reliability.

Field Research Evidence Collection Qualitative Analysis Structured Reporting Documentation

Editorial Intern

The Caravan Magazine

Jan 2020 - Jan 2021 (1 year)

Supported investigative researchers through background research, fact verification, and data collection, developing rigorous standards for information and linguistic quality assessment.

Background Research Fact Checking Data Collection Linguistic Quality Assessment