
Shubham Singh
@shubhamsingh51
AI Quality Manager at Invisible AI evaluating LLM reasoning and model integrity across Hindi and English.
What I'm looking for
At Invisible AI, I review advanced AI outputs for logical consistency and step-by-step reasoning quality. I also fact-check responses and create scoring rubrics to standardize evaluations across technical domains.
At Ksolves, I managed linguistic quality control and safety evaluations for conversational AI models, including red-teaming and reviews against ethical guidelines.
At Sarvamai, I created Hindi and English training prompts and ranked AI responses through pairwise comparisons, assessing accuracy, fluency, context, and cultural nuance.
My work has also included transcribing and reviewing Hindi and English audio datasets at Shoonya AI, where I transcribed over 450 hours and reviewed 800+ hours with a 99% quality accuracy score. I’ve also worked across language resource management, search quality, and STEM content.
Experience
Work history, roles, and key accomplishments
AI Data Trainer & Linguistic Evaluator
Invisible AI
Sep 2025 - Present (1 year 2 months)
Interact with advanced AI systems to review model outputs, identify logical inconsistencies, and evaluate step-by-step reasoning quality. Perform fact-checking and linguistic analysis to ensure high-quality, persona-aligned model generation.
AI Quality Analyst & Linguistic Evaluator
Ksolves
May 2025 - Jun 2026 (1 year 1 month)
Managed linguistic quality control and safety evaluations for conversational AI models, focusing on red-teaming and mitigating model inaccuracies. Audited generative AI outputs against ethical guidelines and applied root-cause thinking to validate model reliability.
Language Resource Manager
NavaData
Mar 2024 - Jun 2025 (1 year 3 months)
Managed capacity, performance, and QA workflows across multiple AI linguistic and translation projects. Spearheaded quality reviews and applied structured guidelines to maximize team efficiency and maintain SLA compliance.
LLM Prompt Rater (Hindi/English)
Sarvamai
Jan 2025 - May 2025 (4 months)
Developed AI training content by creating detailed prompts across various topics. Evaluated and ranked multiple AI responses using pairwise comparisons to enhance accuracy, fluency, contextual relevance, and cultural nuance.
Search & Intent Rater
Appen AI
Jan 2024 - Dec 2024 (11 months)
Audited media and text content for topical exactness and alignment with user search queries to refine algorithmic utility. Conducted pairwise comparisons and data evaluations to optimize search engine ranking algorithms.
Audio Transcriptionist & Evaluator (Hindi/English)
Shoonya AI
Feb 2023 - Dec 2024 (1 year 10 months)
Transcribed over 450 hours and reviewed 800+ hours of complex Hindi and English audio datasets, achieving a consistent 99% quality accuracy score. Assessed edge cases in audio quality, speech patterns, and dialect nuances to train NLP models.
STEM Content Writer & SME
Testbook, Chegg, Adda247
Feb 2022 - Dec 2024 (2 years 10 months)
Authored, translated, and proofread highly technical educational content, demonstrating expert-level step-by-step problem-solving for STEM curricula. Simplified complex scientific concepts into precise Hindi and English training materials.
Hindi Transcription Expert & Search Quality Analyst
OneForma
Jan 2019 - Dec 2022 (3 years 11 months)
Executed diverse data-related tasks including data collection, evaluation, annotation, and object tagging across audio and text content types. Analyzed and rated search engine results based on utility, relevance, and alignment with user intent.
Education
Degrees, certifications, and relevant coursework
University of Rajasthan
Master of Science, Biochemistry
Earned a Master of Science in Biochemistry from the University of Rajasthan in January 2023.
University of Rajasthan
Bachelor of Education, Education
Completed a Bachelor of Education from the University of Rajasthan.
Indira Gandhi National Open University
Master of Arts, Hindi
Pursued a Master of Arts in Hindi from Indira Gandhi National Open University.
University of Rajasthan
Bachelor of Science, Physics, Chemistry, Biology
Earned a Bachelor of Science in Physics, Chemistry, and Biology from the University of Rajasthan in January 2021.
Availability
Location
Authorized to work in
Salary expectations
Job categories
Skills
Interested in hiring Shubham?
You can contact Shubham and 600K+ other talented remote workers on Himalayas.
Message ShubhamGet matched with your dream remote job
Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
