saritha devi
@sarithadevi
Senior Test Engineer specializing in AI/ML automation and data-driven QA for LLM and RAG systems.
IndiaWhat I'm looking for
I’m a Senior Test Engineer with 5+ years of expertise in AI/ML testing, automation, and QA. I’m passionate about driving innovation in AI automation while ensuring quality through data-driven testing methodologies, especially for AI-powered systems, RAG pipelines, and LLM applications.
At Kore.ai, I designed AI-driven retrieval validation strategies using vector embeddings and metadata re-ranking, improving retrieval accuracy by 30%. I also reduced manual testing by 50% by developing an automated evaluation framework for RAG pipelines, and built end-to-end test automation (BDD Cucumber, Karate, Playwright) integrated with Jenkins CI/CD.
I focus on measurable outcomes—conducting performance testing for scalable AI pipelines and minimizing AI hallucinations through prompt engineering & validation frameworks. Earlier, as an Associate Professor, I guided student projects and supported cross-team collaboration—habits I bring to Agile ceremonies, test planning, defect tracking, and reporting via Jira.
Experience
Work history, roles, and key accomplishments
Designed AI-driven retrieval validation and evaluation strategies for LLM/RAG search, improving retrieval accuracy by 30% and reducing manual testing by 50%. Built end-to-end RAG test automation (BDD with Cucumber/Karate/Playwright) integrated with Jenkins CI/CD and supported performance testing and defect tracking via Jira.
Associate Professor
Nawab Shah Alam Khan College of Engineering
Jan 2011 - Jan 2019 (8 years)
Handled academics, guided student projects, and managed departmental activities.
Education
Degrees, certifications, and relevant coursework
VNR Vignana Jyothi Institute of Engineering & Technology
M.Tech, Power Electronics
Completed an M.Tech in Power Electronics at VNR Vignana Jyothi Institute of Engineering & Technology, Hyderabad.
Kakatiya Institute of Technology and Sciences
B.Tech, Electrical & Electronics Engineering
Completed a B.Tech in Electrical & Electronics Engineering at Kakatiya Institute of Technology and Sciences, Warangal.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Social media
Job categories
Skills
Interested in hiring saritha?
You can contact saritha and 90k+ other talented remote workers on Himalayas.
Message sarithaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
