Skip to main content
Prashansa SinghPS
Open to opportunities

Prashansa Singh

@prashansasingh

Expert Prompt Curator and AI Specialist optimizing prompt quality, annotation, and evaluation for next-gen models.

India
Message

What I'm looking for

I’m looking to elevate model quality and evaluation as an Expert Prompt Curator—curating high-impact prompts, driving calibration to gold rubrics, and improving evidence-based annotation quality that makes benchmarks reliable and unbiased.

I’m an AI Specialist and Annotator with 3+ years’ experience in advanced AI training workflows, including Supervised Fine-Tuning (SFT) and RLHF. I focus on prompt curation, annotation quality, and model evaluation to raise real-world model performance.

As an Expert Prompt Curator (Jan 2025–Present), I curate and assess challenging prompts and model queries for benchmarking. I review interaction logs, evaluate rewritten queries for fidelity to user intent, and flag sensitive content in line with safety guidelines, while providing evidence-based rationales aligned to rubrics.

Previously, as an Annotator (Feb 2023–Dec 2024), I produced high-accuracy annotation datasets (95%+ accuracy) for complex gaming AI evaluation. I led and mentored teams, improved productivity by 20% through workflow enhancements and training, and refined annotation pipelines to reduce revision rates through proactive feedback handling.

Earlier roles as an AI Trainer (Feb 2022–Feb 2023; Dec 2020–Feb 2022) strengthened my ability to translate model outputs into actionable improvements. I developed personalized AI models that boosted engagement by 25% and improved diagnostic precision by 40%, and I led quality control initiatives while authoring pipelines to support data generation for training and deployment.

Experience

Work history, roles, and key accomplishments

SA
Current

Expert Prompt Curator

Soul AI

Jan 2025 - Present (1 year 6 months)

Curate and assess prompts and model queries to benchmark AI systems, evaluating fidelity to user intent and aligning scores to rubrics. Perform calibration against gold standards, flag sensitive content per safety guidelines, and support creation of evaluation datasets.

OU

AI Trainer

Outlier

Feb 2022 - Feb 2023 (1 year)

Developed personalized AI models to improve engagement and diagnostic precision, while building and optimizing NLP and deep learning architectures to reduce error rates. Presented analyses and results to executive leadership under tight deadlines.

Education

Degrees, certifications, and relevant coursework

SU

SRM University

Bachelor of Science, Computer Science

2018 - 2022

Earned a Bachelor of Science in Computer Science from SRM University from 2018 to 2022.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan