# Ashutosh Jha

Ashutosh Jha is a remote worker on Himalayas, AI Evaluation Engineer at Bespoke Labs, based in India.

Source: https://himalayas.app/@ashutoshjha7

```text
AI Agentic Developer at Bespoke Labs, building agents graded on real system state and production multi-agent platforms.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 2405k+ INR |
| Job categories | AI Agentic Developer, AI Engineer, AI Evaluation Engineer |
| Skills | LLM Agents, Agentic Workflows, Multi agent orchestration, Agent Architectures, Autonomous Task Automation, LLM Evaluation, Benchmark Design, Graders and Verifiers, LLM As Judge, Red Teaming, Prompt Injection Defense, GuardRails, RAG, Hybrid Retrieval, Vector Databases |
| LinkedIn | https://linkedin.com/in/ashutosh-kumar-jha-ab7929233 |
| GitHub | https://github.com/jhaashutosh07 |

## What I'm looking for

```text
I'm seeking a full-time AI agentic developer role.
```

## About

```text
At Bespoke Labs, I design agentic workflows that let LLM agents diagnose and fix incidents across a 12-microservice platform. I also write Python tooling that grades agents on real system state and closes grader-bypass paths.

At Bespoke Labs, I built graded Kubernetes agent tasks and automated multi-stage grading for Nebula. I also reviewed evaluation tasks and rated agent tool calls across open-source codebases.

At Turing, I engineered Python and C++ LLM optimization pipelines for Alibaba Qwen and ByteDance Doubao. The work raised accuracy 15%, cut hallucination rate 20%, and reduced inference latency 20% with vLLM model serving.

I built Nexus AI, a production multi-agent LLM platform that routes tasks across specialized agents and combines semantic caching with hybrid RAG. I also built hijack-bench, a red-team benchmark that evaluates prompt-injection defenses against agents' real tool calls.
```

## Experience

### AI Evaluation Engineer (current)

Bespoke Labs. Mar 2026 - Present

```text
Designed agentic workflows for autonomous incident diagnosis and repair across a 12-microservice platform, and built Python tooling to secure verifier queries and close grader-bypass paths. Automated multi-stage grading for Kubernetes agent tasks and reviewed evaluation tasks for necessity and milestone progress.
```

Skills: Python, Kubernetes, ArgoCD, Gitea, Prometheus, MongoDB, LLM-Agents, Agentic-Workflows, Multi-agent-orchestration, RBAC, SQL, Grading, Evaluation

### AI Engineer

Turing. Jul 2025 - Mar 2026

```text
Engineered LLM optimization pipelines in Python and C++ (SFT, RLHF, PEFT, LoRA/QLoRA) over 50K+ samples, raising accuracy 15% and cutting hallucination rate 20%. Collaborated with Alibaba and ByteDance teams to tune models and reduce inference latency.
```

Skills: Python, C++, SFT, RLHF, PEFT, LoRAs, QLoRA, MLFlow, VLLM, Distributed-Training, Prompt-Engineering, BLEU, ROUGE

### Software Engineer Intern

Soefia Education Inc. Jan 2025 - Jul 2025

```text
Built and deployed a FastAPI backend with 50+ JWT-secured REST routes serving 1,000+ daily calls. Sped up MongoDB queries on 10K+ records by 25% via indexing and automated testing to 70% coverage.
```

Skills: fastAPI, JWT, REST, MongoDB, Indexing, Testing-Automation

## Education

### Academy of Technology

B.Tech, Computer Science & Business Systems. 2022 - Present. Grade: 8.1/10

Activities and societies: 1800+ LeetCode rating, with 1,400+ problems solved across competitive programming platforms.

```text
Pursuing a B.Tech in Computer Science & Business Systems with a CGPA of 8.1/10.
```

## Tech stack

- Kubernetes
- NumPy
- Pandas
- PostgreSQL
- MongoDB
- Node.js
- Google Analytics
- Databricks
- React
- JavaScript
- Python
- HTML5
- Java
- CSS 3
- C++
- MLflow
- scikit-learn
- Kafka
- FastAPI
- Gemini
- TypeScript
- pytest
- Git
- Docker
- GuardRails
- SQL
- Hugging Face
- LangChain
- ChromaDB
- Pinecone
- vLLM
- Groq
- ArgoCD
- Gitea
- K3s
- LangGraph
- PEFT
- Retrieval-Augmented Generation (RAG)

To contact Ashutosh, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Yash Desai](https://himalayas.app/@yashdesai1): Gen AI & LLM Process Intern, Qualitas Global Services LLP
- [Ayush Tiwari](https://himalayas.app/@ayushtiwari6): Python Engineer LLM, Turing
- [Shashank Thatikonda](https://himalayas.app/@shashankthatikonda): Founding AI Engineer, DexraFlow
- [Kalyan Yenduri](https://himalayas.app/@kalyanyenduri): Agentic AI Systems Engineer, Self Employed
- [Parth Kulshreshtha](https://himalayas.app/@parthkulshreshtha): Associate AI Engineer, Centific
- [Shubham Pandey](https://himalayas.app/@shubhampandeyGenai): Software Engineer, Machine Learning/NLP, Gartner
- [Subhajit Saha](https://himalayas.app/@subhajitsaha): Senior Machine Learning Engineer, Quantiphi
- [Ayush pratap Singh](https://himalayas.app/@ayushpratapsingh2): AI Evaluator, Meridial.ai
- [Aditya Raj](https://himalayas.app/@adityaraj24): AI Engineer, Atlas AI Labs
- [Shaik Farooque](https://himalayas.app/@shaikfarooque): Software Development Engineer II, Amazon