Pankaj Kumar Sharma
@pankajkumarsharma
I evaluate LLM outputs, uncover reasoning failures, and improve AI training quality at scale.
What I'm looking for
I am an AI Quality Analyst, AI Trainer, and Data Annotation Specialist with 6+ years of experience contributing to AI evaluation, data annotation, and quality assurance projects. My experience includes LLM evaluation, hallucination detection, RLHF-related workflows, prompt engineering, multi-turn conversation testing, and evaluating AI-generated responses for accuracy, relevance, reasoning, and instruction-following.
I have worked with organizations and AI platforms including Turing, Outlier, Mercor, Handshake AI, Innodata, RWS Group, and Invisible Technologies. My work has involved evaluating AI responses, creating challenging prompts, identifying reasoning errors and edge cases, annotating text, images, audio, and video, and performing quality control under detailed project guidelines.
A key strength I bring is my strong mathematics and analytical background. I have more than a decade of experience in mathematics education, including teaching students following the American K-12 curriculum from Grades IV–XII. This experience has helped me develop strong logical reasoning, attention to detail, problem-solving, and the ability to identify subtle errors in AI-generated reasoning.
Earlier in my career, I also worked in academic assessment and financial auditing, including evaluating MBA, BBA, and B.Com examinations and contributing to government-related audit work.
I am particularly interested in AI/ML, Generative AI, LLM evaluation, AI safety and quality, data annotation, prompt engineering, financial AI research, mathematics, and analytical problem-solving. I am looking for opportunities where I can combine my AI evaluation experience, analytical skills, mathematics expertise, and attention to quality to help build more accurate, reliable, and useful AI systems.
Experience
Work history, roles, and key accomplishments
Finance at Handshake
Project Seal India
Jul 2026 - Present (1 month)
Crafted adversarial prompts to test AI models, evaluated web search and reasoning, analyzed model failures, and assessed edge cases.
• Crafted adversarial prompts: wrote difficult, nuanced test prompts designed to push AI models past standard internet-trained data limits. Remote
• Evaluated web search and reasoning: tested how effectively models locate relevant data, separate reliable sources from misinformation or low-quality pages, and handle conflicting reports.
• Analyzed model failures: identified situations where t
AI Model Evaluator / Test Prompt Designer
Handshake AI
Jul 2026 - Present (1 month)
Crafted adversarial prompts to test AI models beyond standard data limits, evaluated web search and reasoning, analyzed model failures, and assessed edge cases.
AI Annotator
Mercor
Jun 2026 - Present (2 months)
Synthesized information from large volumes of data to enhance AI model performance, annotated and categorized text, images, and other data, and flagged inconsistencies.
Synthesize information from large volumes of data to enhance AI model performance.
Annotate and categorize text, images, and other data according to detailed guidelines.
Apply predefined rubrics and taxonomies to produce structured, high-quality outputs.
Flag inconsistencies, ambiguities, or errors in datasets to improve data quality.
Contribute to the improvement of AI systems through consistent
AI Quality Analyst
Turing Enterprises
May 2026 - Present (3 months)
Designed and stress-tested multi-turn LLM conversations, evaluated and ranked AI responses, and maintained data-hygiene compliance.
🏷️ Label data (images, text, audio)
📦 Draw bounding boxes / tag objects in images & videos
📝 Annotate text (sentiment, entities, categories)
🎧 Transcribe or tag audio
✔️ Check and correct errors (quality control)
📊 Follow guidelines strictly
⏱️ Complete tasks on time
🔍 Maintain accuracy and consistency
• Annotated and labelled text, image, audio, and video data based on predefined project guidelines; reviewed and validated peer annotations to ensure quality and consistency. • Identified patterns, errors, and edge cases within datasets and escalated issues to the project lead; performed data categorization, segmentation, sentiment labeling, and transcription tasks. • Collaborated with team memb
Data Annotator — AI Models
Innodata Inc.
Jan 2025 - Present (1 year 7 months)
Annotated and labelled text, image, audio, and video data, reviewed peer annotations, and identified patterns and errors.
Data Annotator — AI Models
RWS Group
Jan 2024 - Present (2 years 7 months)
Annotated, labelled, and tagged text, audio, image, and video data, evaluated samples, and ensured high accuracy.
Annotate, label, or tag text, audio, image, or video data based on specific guidelines. Help train and improve AI and machine learning models by preparing data. Evaluate samples, describe contents, assign categories, and adjust captions.
AI Trainer
Outlier
Jul 2023 - Present (3 years 1 month)
Led generative AI training projects, evaluated AI-generated outputs, and applied mathematics and logic expertise to identify reasoning errors.
English Teacher
Ramashis Hindi High School
Feb 2018 - Present (8 years 6 months)
Taught English at Ramashis Hindi High School in Burdwan.
Worked as English Teacher at Ramashis hindi high school. Burdwan.
Data Annotator — AI Models
Invisible Technologies
Mar 2025 - Jan 2026 (10 months)
Labelled data including images, text, and audio, drew bounding boxes, annotated text for sentiment and entities, and performed quality control.
• Play and test video games to ensure optimal quality and engaging user experience.
• Identify and report bugs, glitches, and usability issues to enhance game performance.
• Provide feedback on game mechanics, graphics, and overall gameplay for improvement.
Mathematics Tutor — American Curriculum
Focus Edumatics Pvt. Ltd.
Feb 2021 - Mar 2025 (4 years 1 month)
Conducted live interactive virtual tutoring sessions for 50+ students, specializing in simplifying complex mathematical concepts across the American curriculum.
• Conduct live, interactive virtual tutoring sessions for Grades IV to XII, specializing in simplifying complex mathematical concepts.
• Provide personalized academic support, enhancing students' understanding and performance.
• Maintain detailed records of student progress, identifying and addressing individual learning needs.
• Collaborate with a diverse team to innovate teaching methods and imp
Mathematics Teacher
Clavictor Academy Pvt. Ltd.
Jun 2020 - Jun 2021 (1 year)
Delivered structured mathematics instruction across multiple grade levels, developing tailored lesson plans that improved student academic performance.
Assessment Evaluator
MeritTrac Services Pvt. Ltd.
May 2017 - May 2019 (2 years)
Conducted detailed onscreen evaluations for MBA, BBA, and B.Com examinations, ensuring accurate and fair grading across large student cohorts.
Auditor
Ray & Co. Chartered Accountants
May 2015 - May 2017 (2 years)
Participated in the audit of Sarva Shiksha Mission, ensuring compliance and accurate financial reporting, and collaborated with audit teams to identify discrepancies.
Game QA Tester
Highbrow Technology Inc.
Played and tested video games to ensure optimal quality, identified and reported bugs, and provided structured feedback on game mechanics.
Education
Degrees, certifications, and relevant coursework
EIILM University
Master of Business Administration, Marketing & Finance
2008 - 2010
Pursued an MBA with a focus on Marketing and Finance.
EIILM-Kolkata
Master of Business Administration, Marketing/Marketing Management, General
2008 - 2010
Pursued a Master of Business Administration with a focus on Marketing Management.
EIILM-Kolkata
Master of Business Administration - MBA, Marketing/Marketing Management, General
2008 - 2010
Burdwan University
Bachelor of Commerce, Commerce
2004 - 2007
Completed a Bachelor of Commerce with Honours.
West Bengal Council of Higher Secondary Education
Higher Secondary, Commerce
2001 - 2003
Completed Higher Secondary education in Commerce.
West Bengal Board of Secondary Education
Secondary, General
1999 - 2001
Completed Secondary education.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Social media
Job categories
Skills
Interested in hiring Pankaj Kumar?
You can contact Pankaj Kumar and 90k+ other talented remote workers on Himalayas.
Message Pankaj KumarGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
