# Ayush Vishwakarma

Ayush Vishwakarma is a remote worker on Himalayas, AI Model Trainer at Outlier.ai & Turing, based in India.

Source: https://himalayas.app/@ayushvishwakarma2

```text
Data analyst working on AI evaluation at Outlier.ai and Turing; built a Python tool to benchmark model response quality.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 70k+ INR |
| Job categories | Data Analyst, AI Model Trainer, AI Evaluator |
| Skills | Data Cleaning, Data Validation, Data Annotation, Anomaly Detection, Data Analysis, Large Language Model (LLM) Evaluation, RLHF, Benchmarking, BLEU, ROUGE, Rubric Based Grading, Evaluating Factual Accuracy, Structured Reporting, Python, Pandas |
| GitHub | https://github.com/duhitsayu |

## What I'm looking for

```text
I’m looking to build on my data-cleaning, validation, and AI evaluation experience with Power BI, creating interactive dashboards and data-driven business insights.
```

## About

```text
At Outlier.ai and Turing, I train and evaluate large language model outputs, applying structured rubrics and delivering preference labels across coding, reasoning, and general-knowledge tasks. I also document model failure cases with severity ratings for downstream fine-tuning.

I built a Python benchmarking tool to score labeled responses using BLEU, ROUGE, and a custom factual-accuracy metric. I’ve also contributed to Label Studio and built OffSOS, an Android app for offline emergency coordination over mesh networking.
```

## Experience

### AI Model Trainer (current)

Outlier.ai & Turing. Apr 2026 - Present

```text
Trained and evaluated large language model outputs by ranking responses, writing and refining prompts, and applying structured rubrics for factual accuracy, coherence, and safety. Delivered RLHF-style preference labels across coding, reasoning, and general-knowledge tasks.
```

Skills: LLM-Evaluation, Prompt-Engineering, RLHF, Data-Annotation, Rubric-Based-Grading, Python

### AI Developer & LLM Evaluator

Independent / Freelance. May 2025 - Dec 2025

```text
Benchmarked GPT-4o, Gemini 1.5 Pro, and Claude Sonnet across hundreds of labeled response pairs using BLEU, ROUGE, and a custom factual-accuracy metric. Evaluated model outputs for factual accuracy, coherence, and safety, applying structured rubrics and documenting findings.
```

Skills: LLM-Benchmarking, BLEU, ROUGE, Factual-Accuracy, Python, Data-Analysis

## Education

### Viva Institute of Technology

Bachelor of Engineering, Computer Engineering

Activities and societies: Relevant coursework: Data Structures, Machine Learning, Database Systems, Networks, Cybersecurity

```text
Pursuing a Bachelor of Engineering in Computer Engineering with expected graduation in 2027.
```

## Tech stack

- GitHub
- Pandas
- Python
- Kotlin
- Git
- Label Studio
- Power BI

To contact Ayush, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Murtaza Manzoor](https://himalayas.app/@murtazamanzoor): QA Specialist, Turing
- [Anshul Palarpwar](https://himalayas.app/@anshulpalarpwar): ML Engineer (Project), PredictX
- [Hemanth Raju](https://himalayas.app/@hemanthraju): LLM Evaluator & Trainer, Outlier AI
- [Somil Verma](https://himalayas.app/@somilverma): AI Model Trainer & LLM Evaluator, OpenTrain AI
- [Abhishek Savita](https://himalayas.app/@abhisheksavita): AI Frontend Engineering Intern, FlyRank AI
- [Aaditi Kumari](https://himalayas.app/@aaditikumari): LLM Post Training Intern, Ethara.AI
- [Ankur Roy](https://himalayas.app/@ankurroy): AI Trainer & Evaluation Specialist, Outlier.ai
- [Nagendra Madineni](https://himalayas.app/@nagendramadineni): AI Agent Evaluation & Prompt Engineering, Turing
- [Jayesh Mishra](https://himalayas.app/@jayeshmishra): AI Evaluator, Handshake AI
- [Lubna Fatima](https://himalayas.app/@lubnafatima): Freelance AI Data Annotator / Operations Analyst, Freelance
