Looking for a job

Anji Boddupally

@anjiboddupally

Message

I build evaluation platforms and rigorous LLM, RAG, and agentic AI quality systems.

United Kingdom

Message

At Writer AI, I designed and built the Writer Evals Platform from scratch, enabling dataset management, evaluators, runs, leaderboards, and human-review workflows for LLM, RAG, and agentic systems. I also built the evaluation SDK and lead model comparisons, judge calibration, and production-informed evaluation practice.

I've brought an automation-first quality mindset across Booking.com, ServiceNow, and Infosys, building API and UI test frameworks, CI pipelines, quality tooling, and release-risk processes. I enjoy turning complex product and reliability needs into practical platforms, repeatable evaluation systems, and faster feedback for engineering teams.

Experience

Work history, roles, and key accomplishments

Current

Staff AI Evaluation Engineer

Current

WriterAI

Jun 2025 - Present (1 year 3 months)

Designed and built the Writer Evals Platform (WEP) from the ground up, leading end-to-end evaluation of LLM, RAG, and agentic systems. Owns the platform end-to-end, including backlog, release pipeline, and code reviews.

Python fastAPI Next.js TypeScript PostgreSQL LLM As Judge Langfuse Braintrust Traceloop Auto Blocking GitHub Actions

AI Automation Quality Engineer

WriterAI

Mar 2025 - Jun 2025 (3 months)

Reviewed requirements, prepared test plans, and executed functional test cases against the Writer web app. Developed a framework and automated LLM accuracy regression test suites with Autoblocks AI in Python.

Python Pytest Playwright TypeScript Cursor GitHub Actions

Test Engineer II, Payments (Fintech) & RegTech

Booking.com BV

Sep 2021 - Feb 2025 (3 years 5 months)

Owned E2E testing for regulatory compliance projects, automated API and UI E2E flows, and built CI pipelines. Increased unit coverage by training developers on integration tests using mocks and test containers.

Java Spring Boot Kafka MySQL Playwright Rest Assured JUnit5 Gitlab CI Postman Docker Kubernetes Harness Test Containers Pactflow Grafana C#Maven Allure Gatling DynamoDB Cherrybomb DAST Jira Confluence

Staff SDET, PAR (Performance Analytics & Reporting)

ServiceNow BV

Mar 2017 - Aug 2021 (4 years 5 months)

Designed and implemented comprehensive test plans and test cases, improving software quality across product launches. Ran accessibility, internationalisation, and localisation testing alongside performance checks with JMeter and Google Lighthouse.

Java 8 JUnit4 Maven HttpClient Selenium Git Jenkins MySQL JMeter Accessibility Testing I18N Testing Jira Confluence Google Lighthouse

Automation Test Analyst

Infosys Limited

Aug 2011 - Feb 2017 (5 years 6 months)

Created test strategies and test case designs, wrote manual and automated tests, and performed root-cause analysis. Developed UI and API test automation frameworks and trained QEs on Selenium and RestAssured frameworks.

Java Maven Selenium Git Jira Cucumber BDD