Skip to main content
ajay kumarAK
Looking for a job

ajay kumar

@ajaykumar73

AI Quality Engineering Lead at Coforge, building evaluation frameworks for LLMs, RAG, and AI safety.

United States
Message

At Coforge Ltd, I lead QA for Generative AI, Agentic AI, LLMs, chatbots, and virtual assistants. I define evaluation frameworks for LLMs and RAG, including hallucination detection, prompt validation, and AI safety.

I drive automated quality engineering using Python and API automation. My work also covers QA metrics, defect leakage, test coverage, and root cause analysis across Product, Engineering, DevOps, and business teams.

At Erie Insurance, I developed test automation frameworks to streamline regression testing and established QA metrics and reporting processes. I also led technical teams delivering insurance software solutions and mentored junior developers.

Earlier, at Caesars Entertainment, I collaborated with Agile teams on automated tests and mentored QA Analysts on automation techniques. At NIIT Technologies Ltd, I developed and executed test plans and cases across multiple environments.

Experience

Work history, roles, and key accomplishments

Coforge Ltd logoCL
Current

AI Quality Engineer Lead

Apr 2024 - Present (2 years 7 months)

Lead QA for Generative AI, Agentic AI, LLMs, chatbots, and virtual assistants, covering functional, API, UI, conversational, and end-to-end testing. Define AI evaluation and testing frameworks including LLM evaluation, RAG evaluation, hallucination detection, prompt validation, and AI safety.

Caesars Entertainment logoCE

Senior QA Analyst

Dec 2016 - May 2020 (3 years 5 months)

Collaborated with Agile teams to develop automated tests for achieving sprint goals. Participated in Agile ceremonies to synchronize QA efforts with customer expectations and project timelines.

NIIT Technologies Ltd logoNL

Test Engineer

NIIT Technologies Ltd

Jan 2013 - Jan 2016 (3 years)

Developed and executed comprehensive test plans and cases across multiple environments to validate software performance and reliability. Collaborated with developers and analysts to clarify features and acceptance criteria.

Education

Degrees, certifications, and relevant coursework

MU

Mahamaya Technical University

Master's Degree, Computer Applications

Grade: 71%

Completed a Master's degree in Computer Applications in 2013.

CU

CCS University

Bachelor's Degree, Computer Applications

Grade: 70%

Completed a Bachelor's degree in Computer Applications in 2010.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan