# Aishwarya Rajawat

Aishwarya Rajawat is a remote worker on Himalayas, LLM Evaluator / Software Engineering Benchmark Author at AirDawg Labs, based in India.

Source: https://himalayas.app/@aishwaryarajawat

```text
AI & Software Engineer | IIIT Kota CSE | LLM Evaluation & Terminal-Bench | AI Agents, Benchmarking, Backend & Full-Stack Engineering
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 2019k+ INR |
| Job categories | LLM Evaluator, Software Engineer, AI Engineer |
| Skills | LLM Evaluation, Benchmark Design, Hidden Test Suites, Deterministic Verification, Oracle Implementation, Reference Implementation (RI), Repository Development, Debugging, Testing, Unit Testing, Integration Testing, AI Voice Agent, Agentic AI, RAG, Data Structures And Algorithms |
| LinkedIn | https://https://www.linkedin.com/in/aishwarya-rajawat-6bb043245/ |
| GitHub | https://https://github.com/AishwaryaRajawat |

## About

```text
I’m a Computer Science graduate from IIIT Kota specializing in AI engineering, software engineering, LLM evaluation, and AI-agent benchmarking.

I have hands-on experience with Terminal-Bench 2 and frontier-model evaluation, where I create challenging, reproducible benchmark tasks across software engineering, debugging, cybersecurity, scientific computing, data processing, machine learning, games, and system administration.

My benchmark engineering work includes Docker-based environments, oracle/reference implementations, deterministic verifiers, automated test suites, reproducibility validation, failure analysis, and reward-hacking prevention. I enjoy designing tasks that require genuine engineering and reasoning rather than simple pattern matching.

Beyond evaluation, I have experience building AI and software systems using Python, FastAPI, Node.js, React, Docker, Linux/Bash, LangChain, CrewAI, RAG, vector databases, LLM APIs, and SQL/NoSQL databases. I have worked through AI/software engineering internships and freelance projects focused on AI agents, evaluation infrastructure, and production software.

I’m interested in working on frontier AI evaluation, coding-agent benchmarks, LLM/agentic systems, AI infrastructure, backend engineering, and challenging software-engineering problems.
```

## Experience

### LLM Evaluator / Software Engineering Benchmark Author (current)

AirDawg Labs. Jun 2026 - Present

```text
Author software engineering benchmark tasks for Project Sentinel Ultra and Terminus 2, evaluating advanced AI coding agents on realistic debugging, implementation, and repository-level problems. Design maintainer-style issues and build deterministic hidden test suites with reference implementations.
```

Skills: LLM-Evaluation, Benchmark-Design, Hidden-Test-Suites, Docker, Debugging, Repository-Development

### AI Engineering Intern

Somir AI. Feb 2026 - Jun 2026

```text
Engineered AI-powered voice agent workflows for real-time conversational applications, focusing on reliable tool execution, context handling, and response quality. Designed and optimized RAG pipelines for improved retrieval relevance and contextual grounding.
```

Skills: AI-Voice-Agent, RAG, Lang-Chain, LangGraph, Crew-AI, Langsmith, MCP, Docker, Linux, Git, Python, Debugging, Optimization

## Education

### Indian Institute of Information Technology Kota

Bachelor of Technology, Computer Science Engineering. 2022 - Present

```text
Pursuing a Bachelor of Technology in Computer Science Engineering, expected to graduate in 2026.
```

### Vivekanand Vidya Vihar H.S. School

Class XII, General. 2020 - 2021. Grade: 91.2%

```text
Completed Class XII with a percentage of 91.2%.
```

## Tech stack

- Postman
- Telegram API
- GitHub
- Jira
- JavaScript
- Python
- FastAPI
- Linux
- Git
- Docker
- SQL
- LangChain
- CrewAI
- Google Gemini API
- Cursor
- GitHub Copilot
- Faiss
- LangGraph
- LangSmith
- Model Context Protocol (MCP)
- Claude Code
- ChatGPT
- Retrieval-Augmented Generation (RAG)

To contact Aishwarya, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Jash Parmar](https://himalayas.app/@jash2884): LLM Trainer , Alignerr
- [Abhishek Singh Rathore](https://himalayas.app/@abhisheksinghrathore): LLM Engineer, Turing
- [Parth Kulshreshtha](https://himalayas.app/@parthkulshreshtha): Associate AI Engineer, Centific
- [Shlok Sharma](https://himalayas.app/@shloksharma1): Software Engineer Intern, ITJobxs
- [Gagandeep Suthar](https://himalayas.app/@gagandeepsuthar): AI System Evaluation Intern, Airdawg Labs
- [dileep Sri](https://himalayas.app/@dileepsri): AI Evaluation Specialist, Handshake AI Fellowship
- [Aman Yadav](https://himalayas.app/@amanyadav17): AI Response Quality Evaluator, Outlier.ai
- [Charan User](https://himalayas.app/@charanuser10): AI Model Evaluation / Technical Contributor, Project based work
- [Divakar Mekala](https://himalayas.app/@divakarmekala): AI Training Contractor, Project Dynamo
- [Shubh Gupta](https://himalayas.app/@shubhgupta): AI Expert Contributor, Evaluation Design, Snorkel AI