Shivani Dubey
@shivanidubey1
I evaluate and improve AI systems through RLHF, LLM assessment, annotation, and quality review.
IndiaWhat I'm looking for
I've evaluated AI responses for Mercor and Scale AI's Outlier Platform, providing structured human feedback, prompt evaluation, and quality review across AI projects.
At Outlier, I've completed 1,000+ AI evaluation, annotation, and quality-review tasks while maintaining 95%+ quality scores and earning Oracle status as a trusted quality contributor. My work spans RLHF, SFT, Generalist AI, Audio AI, and AI Safety projects.
I've also annotated ML datasets with Labelbox, produced accurate audio transcriptions for TransPerfect, and taught computer science subjects including data structures, DBMS, operating systems, theory of computing, and machine learning.
Experience
Work history, roles, and key accomplishments
Evaluate AI responses and provide structured human feedback. Perform prompt evaluation and quality review while meeting project turnaround timelines.
Worked on RLHF, SFT, Generalist, Audio, and AI Safety projects. Completed over 1,000 AI evaluation, annotation, and quality review tasks while maintaining 95%+ quality scores and earning Oracle status.
Visiting Computer Education Instructor
Government Schools, Madhya Pradesh
Deliver computer education lectures for Classes IX and X on an assignment basis.
Annotated ML datasets and performed QA checks.
Produced accurate audio transcriptions.
Guest Faculty
Media Computer Education (Affiliated with MCU, Bhopal)
Jan 2018 - Dec 2022 (4 years 11 months)
Taught data structures, DBMS, operating systems, theory of computing, and machine learning.
Education
Degrees, certifications, and relevant coursework
MCU, Bhopal
M.Sc., Computer Science
Completed an M.Sc. in Computer Science from MCU, Bhopal in 2018.
Barkatullah University, Bhopal
BCA, Computer Applications
Completed a BCA from Barkatullah University, Bhopal in 2009.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Shivani?
You can contact Shivani and 90k+ other talented remote workers on Himalayas.
Message ShivaniGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
