Looking for a job

Arnab Patra

@arnabpatra2

Quality assurance auditor at RWS, auditing AI speech and TTS evaluations with evidence-based feedback.

At RWS, I audit annotator evaluations of text-to-speech outputs, checking pronunciation, audio quality, naturalness, and speaker similarity against detailed rubrics. I’ve completed 500+ TTS audits across 50 hours and document judgments with clips, timestamps, and reasons.

At RWS, I also audit evaluations of live multilingual speech-to-speech conversations. I’ve completed 400+ conversation audits across 100+ hours, checking ratings and missed or falsely flagged issues such as latency, hallucination, and interruption.

As an AI Response Evaluator at Outlier, I evaluated voice AI outputs and executed red-team scenarios. I also transcribed Bengali audio and video at GoTranscript, and use Praat for acoustic and phonetic analysis.

Experience

Work history, roles, and key accomplishments

Current

Quality Assurance Auditor, Speech-to-Speech Evaluation

Current

RWS

Jul 2026 - Present (3 months)

Completed 400+ AI conversation audits across 100+ hours, auditing annotator evaluations of live multilingual speech-to-speech conversations. Verified ratings, classified model errors by severity, and applied auto-fail criteria.

Speech to Speech Evaluation AI model evaluation Quality Auditing Error Classification Localization Judgment Evidence Based Feedback

Current

Quality Assurance Auditor, Text-to-Speech Evaluation

Current

RWS

Completed 500+ text-to-speech audits across 50 hours, scoring annotator performance against rubrics and classifying errors by severity. Verified pronunciation, text normalization, and prosody against locale-specific conventions.

Text To Speech Evaluation Quality Auditing Pronunciation assessment Audio Quality Assessment Error Classification Inter Annotator Calibration Feedback Writing

AI Response Evaluator

Outlier

Jun 2026 - Jul 2026 (1 month)

Evaluated voice AI outputs side by side for naturalness, utility, and instruction adherence. Executed red-team scenarios targeting hallucination handling, interruption handling, and persona alignment.

AI Evaluation Voice AI Red Team Testing Naturalness Assessment Instruction Adherence Rationale Writing

Bengali Transcriptionist

GoTranscript

May 2026 - Jun 2026 (1 month)

Transcribed Bengali audio and video in full-verbatim, clean-verbatim, timestamped, and sound-event formats, including difficult material with overlapping speech and background noise.

Bengali Transcription Verbatim Transcription Time Stamping Non Speech Event Annotation Audio Listening