# Shubham Singh

Shubham Singh is a remote worker on Himalayas, AI Data Trainer & Linguistic Evaluator at Invisible AI, based in India.

Source: https://himalayas.app/@shubhamsingh51

```text
AI Quality Manager at Invisible AI evaluating LLM reasoning and model integrity across Hindi and English.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 498k+ INR |
| Job categories | AI Quality Analyst, Localization Specialist, Writer |
| Skills | LLM Evaluation, Reasoning Quality Assessment, Bilingual Annotation, RLHF, Pairwise Comparisons, Red Teaming, AI Safety Evaluation, Prompt Generation, Fact Checking, Linguistic Quality Control, Conversational Auditing, Translation, Localization, MQM, LQA |

## What I'm looking for

```text
I’m looking for remote, part-time AI evaluation work where I can contribute high-quality evaluations for at least 15 hours weekly.
```

## About

```text
At Invisible AI, I review advanced AI outputs for logical consistency and step-by-step reasoning quality. I also fact-check responses and create scoring rubrics to standardize evaluations across technical domains.

At Ksolves, I managed linguistic quality control and safety evaluations for conversational AI models, including red-teaming and reviews against ethical guidelines.

At Sarvamai, I created Hindi and English training prompts and ranked AI responses through pairwise comparisons, assessing accuracy, fluency, context, and cultural nuance.

My work has also included transcribing and reviewing Hindi and English audio datasets at Shoonya AI, where I transcribed over 450 hours and reviewed 800+ hours with a 99% quality accuracy score. I’ve also worked across language resource management, search quality, and STEM content.
```

## Experience

### AI Data Trainer & Linguistic Evaluator (current)

Invisible AI. Sep 2025 - Present

```text
Interact with advanced AI systems to review model outputs, identify logical inconsistencies, and evaluate step-by-step reasoning quality. Perform fact-checking and linguistic analysis to ensure high-quality, persona-aligned model generation.
```

Skills: AI-Evaluation, Reasoning-Quality-Assessment, Fact-Checking, Linguistic-Analysis, Prompt-Generation, Rubric-Based-Scoring

### AI Quality Analyst & Linguistic Evaluator

Ksolves. May 2025 - Jun 2026

```text
Managed linguistic quality control and safety evaluations for conversational AI models, focusing on red-teaming and mitigating model inaccuracies. Audited generative AI outputs against ethical guidelines and applied root-cause thinking to validate model reliability.
```

Skills: AI-Quality-Assurance, Red-Teaming, Generative-AI-Auditing, Root-Cause-Analysis, Ethical-guidelines

### Language Resource Manager

NavaData. Mar 2024 - Jun 2025

```text
Managed capacity, performance, and QA workflows across multiple AI linguistic and translation projects. Spearheaded quality reviews and applied structured guidelines to maximize team efficiency and maintain SLA compliance.
```

Skills: Project-Management, QA-Processes, SLA-Compliance, Team-Coordination, Translation-Management

### LLM Prompt Rater (Hindi/English)

Sarvamai. Jan 2025 - May 2025

```text
Developed AI training content by creating detailed prompts across various topics. Evaluated and ranked multiple AI responses using pairwise comparisons to enhance accuracy, fluency, contextual relevance, and cultural nuance.
```

Skills: Prompt-Generation, Pairwise-Comparisons, AI-Evaluation, Hindi, English, Cultural-Nuances

### Search & Intent Rater

Appen AI. Jan 2024 - Dec 2024

```text
Audited media and text content for topical exactness and alignment with user search queries to refine algorithmic utility. Conducted pairwise comparisons and data evaluations to optimize search engine ranking algorithms.
```

Skills: Search-Quality, Pairwise-Comparisons, Data-Evaluation, Algorithm-Optimization, User-Intent-Analysis

### Audio Transcriptionist & Evaluator (Hindi/English)

Shoonya AI. Feb 2023 - Dec 2024

```text
Transcribed over 450 hours and reviewed 800+ hours of complex Hindi and English audio datasets, achieving a consistent 99% quality accuracy score. Assessed edge cases in audio quality, speech patterns, and dialect nuances to train NLP models.
```

Skills: Audio-Transcription, Hindi, English, NLP-Model-Training, Quality-Assurance, Attention-To-Detail

### STEM Content Writer & SME

Testbook, Chegg, Adda247. Feb 2022 - Dec 2024

```text
Authored, translated, and proofread highly technical educational content, demonstrating expert-level step-by-step problem-solving for STEM curricula. Simplified complex scientific concepts into precise Hindi and English training materials.
```

Skills: STEM-Education, Content-Writing, Translation, Proofreading, Hindi, English, Problem-Solving

### Hindi Transcription Expert & Search Quality Analyst

OneForma. Jan 2019 - Dec 2022

```text
Executed diverse data-related tasks including data collection, evaluation, annotation, and object tagging across audio and text content types. Analyzed and rated search engine results based on utility, relevance, and alignment with user intent.
```

Skills: Data-Annotation, Object-Tagging-And-Classification, Search-Quality, Hindi-Transcription, Data-Collection, Evaluation

## Education

### University of Rajasthan

Master of Science, Biochemistry

```text
Earned a Master of Science in Biochemistry from the University of Rajasthan in January 2023.
```

### University of Rajasthan

Bachelor of Education, Education

```text
Completed a Bachelor of Education from the University of Rajasthan.
```

### Indira Gandhi National Open University

Master of Arts, Hindi

```text
Pursued a Master of Arts in Hindi from Indira Gandhi National Open University.
```

### University of Rajasthan

Bachelor of Science, Physics, Chemistry, Biology

```text
Earned a Bachelor of Science in Physics, Chemistry, and Biology from the University of Rajasthan in January 2021.
```

## Tech stack

- Jira
- Python
- Trello

To contact Shubham, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Vikash ajmera User](https://himalayas.app/@vikashajmerauser): A.I. Trainer, Production Team, SAMA.AI
- [Asha Kumari](https://himalayas.app/@ashakumari): Bilingual Cultural Expert Rater, welocalize
- [Anubhav Panwar](https://himalayas.app/@anubhavpanwar): AI Prompt Engineer, Freelance
- [Aryan Mishra](https://himalayas.app/@aryanmishra1): AI Data Annotation & LLM Evaluation, Freelance / Independent Projects
- [Kushal Jaiswal](https://himalayas.app/@kushaljaiswal): AI Trainer / LLM Evaluator, Outlier AI (Scale AI)
- [Shubham User](https://himalayas.app/@shubhamuser23): Advanced AI Data Trainer, Abaka.AI
- [Mohini Yadav](https://himalayas.app/@mohiniyadav): AI/LLM Analyst, Innodata
- [SHUBHAM MISHRA](https://himalayas.app/@shubhammishra10): AI Data Quality & Annotation Reviewer, OpSquad AI
- [Shivani Chaudhary](https://himalayas.app/@shivanichaudhary1): Freelance Investigative Journalist, Self Employed
- [Rahul Kumar](https://himalayas.app/@rahulkumar119): Hindi Linguistic & Content Evaluator, Independent
