Skip to main content
SS
Looking for a job

Shubham Singh

@shubhamsingh51

AI Quality Manager at Invisible AI evaluating LLM reasoning and model integrity across Hindi and English.

India
Message

What I'm looking for

I’m looking for remote, part-time AI evaluation work where I can contribute high-quality evaluations for at least 15 hours weekly.

At Invisible AI, I review advanced AI outputs for logical consistency and step-by-step reasoning quality. I also fact-check responses and create scoring rubrics to standardize evaluations across technical domains.

At Ksolves, I managed linguistic quality control and safety evaluations for conversational AI models, including red-teaming and reviews against ethical guidelines.

At Sarvamai, I created Hindi and English training prompts and ranked AI responses through pairwise comparisons, assessing accuracy, fluency, context, and cultural nuance.

My work has also included transcribing and reviewing Hindi and English audio datasets at Shoonya AI, where I transcribed over 450 hours and reviewed 800+ hours with a 99% quality accuracy score. I’ve also worked across language resource management, search quality, and STEM content.

Experience

Work history, roles, and key accomplishments

IA
Current

AI Data Trainer & Linguistic Evaluator

Invisible AI

Sep 2025 - Present (1 year 2 months)

Interact with advanced AI systems to review model outputs, identify logical inconsistencies, and evaluate step-by-step reasoning quality. Perform fact-checking and linguistic analysis to ensure high-quality, persona-aligned model generation.

KS

AI Quality Analyst & Linguistic Evaluator

Ksolves

May 2025 - Jun 2026 (1 year 1 month)

Managed linguistic quality control and safety evaluations for conversational AI models, focusing on red-teaming and mitigating model inaccuracies. Audited generative AI outputs against ethical guidelines and applied root-cause thinking to validate model reliability.

AI Quality AssuranceRed Teaming
Generative AI Auditing
Root Cause Analysis
Ethical guidelines
SA

LLM Prompt Rater (Hindi/English)

Sarvamai

Jan 2025 - May 2025 (4 months)

Developed AI training content by creating detailed prompts across various topics. Evaluated and ranked multiple AI responses using pairwise comparisons to enhance accuracy, fluency, contextual relevance, and cultural nuance.

AA

Search & Intent Rater

Appen AI

Jan 2024 - Dec 2024 (11 months)

Audited media and text content for topical exactness and alignment with user search queries to refine algorithmic utility. Conducted pairwise comparisons and data evaluations to optimize search engine ranking algorithms.

Search Quality
Pairwise ComparisonsData Evaluation
Algorithm Optimization
User Intent Analysis
SA

Audio Transcriptionist & Evaluator (Hindi/English)

Shoonya AI

Feb 2023 - Dec 2024 (1 year 10 months)

Transcribed over 450 hours and reviewed 800+ hours of complex Hindi and English audio datasets, achieving a consistent 99% quality accuracy score. Assessed edge cases in audio quality, speech patterns, and dialect nuances to train NLP models.

Audio TranscriptionHindiEnglish
NLP Model Training
Quality Assurance
Attention To Detail
TA

STEM Content Writer & SME

Testbook, Chegg, Adda247

Feb 2022 - Dec 2024 (2 years 10 months)

Authored, translated, and proofread highly technical educational content, demonstrating expert-level step-by-step problem-solving for STEM curricula. Simplified complex scientific concepts into precise Hindi and English training materials.

ON

Hindi Transcription Expert & Search Quality Analyst

OneForma

Jan 2019 - Dec 2022 (3 years 11 months)

Executed diverse data-related tasks including data collection, evaluation, annotation, and object tagging across audio and text content types. Analyzed and rated search engine results based on utility, relevance, and alignment with user intent.

Data Annotation
Object Tagging And Classification
Search Quality
Hindi Transcription
Data CollectionEvaluation

Education

Degrees, certifications, and relevant coursework

University of Rajasthan logoUR

University of Rajasthan

Master of Science, Biochemistry

Earned a Master of Science in Biochemistry from the University of Rajasthan in January 2023.

University of Rajasthan logoUR

University of Rajasthan

Bachelor of Education, Education

Completed a Bachelor of Education from the University of Rajasthan.

Indira Gandhi National Open University logoIU

Indira Gandhi National Open University

Master of Arts, Hindi

Pursued a Master of Arts in Hindi from Indira Gandhi National Open University.

University of Rajasthan logoUR

University of Rajasthan

Bachelor of Science, Physics, Chemistry, Biology

Earned a Bachelor of Science in Physics, Chemistry, and Biology from the University of Rajasthan in January 2021.

Tech stack

Software and tools used professionally

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

498k+ INR

Skills

LLM Evaluation
Reasoning Quality Assessment
Bilingual Annotation
RLHFPairwise ComparisonsRed Teaming
AI Safety Evaluation
Prompt GenerationFact Checking
Linguistic Quality Control
Conversational Auditing
TranslationLocalization
MQM
LQA

Interested in hiring Shubham?

You can contact Shubham and 600K+ other talented remote workers on Himalayas.

Message Shubham

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan