Skip to main content
PS
Open to opportunities

Pankaj Kumar Sharma

@pankajkumarsharma

I evaluate LLM outputs, uncover reasoning failures, and improve AI training quality at scale.

India
Message

What I'm looking for

I'm seeking a full-time AI/ML QA role where I can evaluate LLM behavior, detect hallucinations and reasoning failures, contribute to RLHF workflows, and improve model quality at scale.

I am an AI Quality Analyst, AI Trainer, and Data Annotation Specialist with 6+ years of experience contributing to AI evaluation, data annotation, and quality assurance projects. My experience includes LLM evaluation, hallucination detection, RLHF-related workflows, prompt engineering, multi-turn conversation testing, and evaluating AI-generated responses for accuracy, relevance, reasoning, and instruction-following.

I have worked with organizations and AI platforms including Turing, Outlier, Mercor, Handshake AI, Innodata, RWS Group, and Invisible Technologies. My work has involved evaluating AI responses, creating challenging prompts, identifying reasoning errors and edge cases, annotating text, images, audio, and video, and performing quality control under detailed project guidelines.
A key strength I bring is my strong mathematics and analytical background. I have more than a decade of experience in mathematics education, including teaching students following the American K-12 curriculum from Grades IV–XII. This experience has helped me develop strong logical reasoning, attention to detail, problem-solving, and the ability to identify subtle errors in AI-generated reasoning.

Earlier in my career, I also worked in academic assessment and financial auditing, including evaluating MBA, BBA, and B.Com examinations and contributing to government-related audit work.

I am particularly interested in AI/ML, Generative AI, LLM evaluation, AI safety and quality, data annotation, prompt engineering, financial AI research, mathematics, and analytical problem-solving. I am looking for opportunities where I can combine my AI evaluation experience, analytical skills, mathematics expertise, and attention to quality to help build more accurate, reliable, and useful AI systems.

Experience

Work history, roles, and key accomplishments

Handshake logoHA
Current

Project Seal India, Finance

Jul 2026 - Present (1 month)

• Crafted adversarial prompts: wrote difficult, nuanced test prompts designed to push AI models past standard internet-trained data limits. Remote
• Evaluated web search and reasoning: tested how effectively models locate relevant data, separate reliable sources from misinformation or low-quality pages, and handle conflicting reports.
• Analyzed model failures: identified situations where t

Mercor logoME
Current

Annotator

Jun 2026 - Present (2 months)

Synthesize information from large volumes of data to enhance AI model performance.
Annotate and categorize text, images, and other data according to detailed guidelines.
Apply predefined rubrics and taxonomies to produce structured, high-quality outputs.
Flag inconsistencies, ambiguities, or errors in datasets to improve data quality.
Contribute to the improvement of AI systems through consistent

Invisible Technologies logoIT
Current

Data Annotation (AI Model)

Apr 2026 - Present (4 months)

🏷️ Label data (images, text, audio)
📦 Draw bounding boxes / tag objects in images & videos
📝 Annotate text (sentiment, entities, categories)
🎧 Transcribe or tag audio
✔️ Check and correct errors (quality control)
📊 Follow guidelines strictly
⏱️ Complete tasks on time
🔍 Maintain accuracy and consistency

Innodata Inc. logoII
Current

Data Annotator

Oct 2025 - Present (10 months)

• Annotated and labelled text, image, audio, and video data based on predefined project guidelines; reviewed and validated peer annotations to ensure quality and consistency. • Identified patterns, errors, and edge cases within datasets and escalated issues to the project lead; performed data categorization, segmentation, sentiment labeling, and transcription tasks. • Collaborated with team memb

RWS Group logoRG
Current

Data Annotator

Jan 2024 - Present (2 years 7 months)

Annotate, label, or tag text, audio, image, or video data based on specific guidelines. Help train and improve AI and machine learning models by preparing data. Evaluate samples, describe contents, assign categories, and adjust captions.

RS
Current

English Teacher

Ramashis Hindi High School

Feb 2018 - Present (8 years 6 months)

Taught English at Ramashis Hindi High School in Burdwan.

Highbrow Technology Inc logoHI

Gamer

Jan 2025 - Mar 2025 (2 months)

• Play and test video games to ensure optimal quality and engaging user experience.
• Identify and report bugs, glitches, and usability issues to enhance game performance.
• Provide feedback on game mechanics, graphics, and overall gameplay for improvement.

Focus Edumatics Pvt. Ltd logoFL

Mathematics Tutor

Feb 2021 - Jan 2025 (3 years 11 months)

• Conduct live, interactive virtual tutoring sessions for Grades IV to XII, specializing in simplifying complex mathematical concepts.
• Provide personalized academic support, enhancing students' understanding and performance.
• Maintain detailed records of student progress, identifying and addressing individual learning needs.
• Collaborate with a diverse team to innovate teaching methods and imp

CL

Mathematics Teacher

Clavictor Academy Pvt. Ltd.

Jun 2020 - Jun 2021 (1 year)

Delivered structured mathematics instruction across multiple grade levels, developing tailored lesson plans that improved student academic performance.

ML

Assessment Evaluator

MeritTrac Services Pvt. Ltd.

May 2017 - May 2019 (2 years)

Conducted detailed onscreen evaluations for MBA, BBA, and B.Com examinations, ensuring accurate and fair grading across large student cohorts.

RA

Auditor

Ray & Co. Chartered Accountants

May 2015 - May 2017 (2 years)

Participated in the audit of Sarva Shiksha Mission, ensuring compliance and accurate financial reporting, and collaborated with audit teams to identify discrepancies.

Education

Degrees, certifications, and relevant coursework

EU

EIILM University

Master of Business Administration, Marketing & Finance

2008 - 2010

Pursued an MBA with a focus on Marketing and Finance.

EI

EIILM-Kolkata

Master of Business Administration, Marketing/Marketing Management, General

2008 - 2010

Pursued a Master of Business Administration with a focus on Marketing Management.

EI

EIILM-Kolkata

Master of Business Administration - MBA, Marketing/Marketing Management, General

2008 - 2010

BU

Burdwan University

Bachelor of Commerce, Commerce

2004 - 2007

Completed a Bachelor of Commerce with Honours.

WE

West Bengal Council of Higher Secondary Education

Higher Secondary, Commerce

2001 - 2003

Completed Higher Secondary education in Commerce.

WE

West Bengal Board of Secondary Education

Secondary, General

1999 - 2001

Completed Secondary education.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan