Open to opportunities

nakkala Prathap Reddy

@nakkalaprathapreddy

AI test automation engineer with 7 years’ experience validating LLMs and RAG systems for accuracy, reliability, and fairness.

India

Message

What I'm looking for

I’m looking for a role where I can own AI quality assurance for LLMs and RAG—building intelligent, automated evaluation frameworks (e.g., DeepEval/RAGAS), enforcing data validation/drift checks, and scaling reliable self-healing test pipelines.

I’m a highly motivated AI Automation Engineer focused on AI test automation and GenAI evaluation. Over 7 years, I’ve validated LLMs and Retrieval-Augmented Generation (RAG) systems to ensure accuracy, reliability, and fairness, building automation that continuously improves quality.

I design and implement AI testing frameworks that integrate tools like DeepEval, RAGAS, Great Expectations, and EvidentlyAI to measure context relevance, response correctness, hallucination rate, schema quality, and data drift. I’ve also developed self-healing ML pipelines that halt retraining when data quality or drift failures are detected, and I build end-to-end automation with PyTest, Playwright/Selenium, and CI workflows to keep evaluation fast and dependable.

Experience

Work history, roles, and key accomplishments

Current

AI Automation Engineer

Current

Sutherland

Apr 2025 - Present (1 year 2 months)

Designed and implemented AI testing frameworks to validate LLMs, embeddings, and retrieval accuracy. Integrated DeepEval and RAGAS for RAG pipeline evaluation, and built Great Expectations/EvidentlyAI modules for schema and data-drift monitoring with self-healing pipelines.

DeepEval Ragas Great Expectations Evidently AI LLM Evaluation RAG Testing Python Playwright Self Healing Pipelines

Automation Engineer

Ato's

Jul 2022 - Nov 2023 (1 year 4 months)

Built AI testing frameworks to validate LLMs, embeddings, and retrieval accuracy, using RAGAS to compare retrieved versus generated answers. Automated validation workflows with PyTest and implemented RAG-related test automation using Playwright and Selenium.

Ragas Retrieval Accuracy Pytest Playwright Selenium Test Automation API Testing Git CI Pipelines

Automation Engineer

Smartenspaces

Aug 2021 - Jul 2022 (11 months)

Developed and executed test plans, test cases, and test matrices for QA validation of RAG systems. Created and maintained a hybrid automation framework using Selenium WebDriver and implemented automated database verification using SQL (Oracle).

RAG Selenium Webdriver Automation Framework Cucumber SQL Oracle SQL Azure DevOps Acceptance Testing Java Python

Test Automation Engineer

BSH

Jan 2021 - Aug 2021 (7 months)

Prepared test plans, test cases, and test scripts and maintained test metrics for application and database verification against functional requirements. Established agile acceptance test automation using Cucumber and Maven, integrated with CI to run nightly automated tests via Jenkins.

Test Planning Cucumber Maven Selenium Webdriver Jenkins CI CD Agile Testing Test Automation Database Testing

Test Automation Engineer

NTT Data

Sep 2018 - Jan 2021 (2 years 4 months)

Developed and executed test plans, test cases, and test matrices using QA best practices for application and database verification. Built acceptance test automation using Cucumber, and used Maven with Selenium WebDriver and Jenkins to run nightly automated test suites.

Test Planning Cucumber Maven Selenium Webdriver Jenkins Nightly Builds Agile Testing CI CD

Test Automation Engineer

IBM

Mar 2016 - Nov 2016 (8 months)

Prepared test plans, test cases, and test scripts along with test metrics for application and database verification. Implemented acceptance test automation using Cucumber with Maven-based Selenium WebDriver projects and Jenkins-driven nightly CI runs.