Skip to main content
Siddhesh ShirkeSS
Looking for a job

Siddhesh Shirke

@siddheshshirke

AI Agent Tester and evaluator who tested ChatGPT and Muse on everyday tasks and documented reproducible failures.

India
Message

At Outlier, I tested ChatGPT, Muse, and other AI agents on everyday tasks, scoring accuracy, helpfulness, and instruction-following.

I recorded agent sessions and wrote reproducible bug reports that captured expected versus actual behavior, severity, and suggested fixes.

As a Quality Assurance / Data Annotation Specialist, I review and label data against strict rubrics, flag unclear instructions, and meet weekly delivery targets.

On my AI Agent Task Benchmark project, I built a 30-task checklist to compare ChatGPT and Muse. I also kept a Prompt Failure Log to sort agent errors by type and severity.

Experience

Work history, roles, and key accomplishments

OU

AI Agent Tester / AI Evaluator

Outlier

Mar 2025 - Jun 2025 (3 months)

Tested ChatGPT, Muse and other AI agents on 40+ everyday tasks, scoring accuracy, helpfulness, and instruction-following. Recorded screen captures of 100+ agent sessions and wrote clear bug reports with expected vs. actual behavior and suggested fixes.

Education

Degrees, certifications, and relevant coursework

VA

Viva College of Science and Arts

Bachelor of Science, Information Technology

Pursuing a Bachelor of Science in Information Technology, expected to complete in 2028.

Tech stack

Software and tools used professionally

Interested in hiring Siddhesh?

You can contact Siddhesh and 90k+ other talented remote workers on Himalayas.

Message Siddhesh

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan