Looking for a job

Sumit Joshi

@sumitjoshi2

Message

I evaluate LLM responses and optimize prompts for reliable AI systems.

India

Message

What I'm looking for

I'm looking for opportunities to evaluate and improve AI systems through prompt engineering, RLHF, and LLM quality assessment, while applying my Physics, Mathematics, analytical, and communication skills to meaningful products.

At Soul AI, I evaluate LLM outputs across 13+ quality parameters, including accuracy, relevance, tone, and code quality. I also perform RLHF annotation, providing ratings and detailed justifications that improve AI training data.

I've created 500+ JEE-level Physics solutions at Careers360 and written articles, blogs, and FAQs across Physics and Mathematics. My work combines strong subject knowledge with clear, engaging communication.

Through ASHINE SVNIT, I built a TENS-based period pain relief wearable prototype, validated customer needs through surveys, and presented it at SVNIT StartupExpo. I enjoy applying design thinking, data analysis, and AI evaluation to practical products and learning experiences.

Experience

Work history, roles, and key accomplishments

AI / LLM Model Response Evaluator

Soul AI

Aug 2025 - Apr 2026 (8 months)

Evaluated LLM outputs against 13+ quality parameters including accuracy, relevance, tone, and code quality. Conducted RLHF annotation tasks and handled ambiguous cases with structured judgment.

LLM Evaluation RLHF Quality Assessment Prompt Engineering Annotations