Open to opportunities

shiraz khan

@shirazkhan

Message

Senior QA automation engineer building GenAI test systems and reliable CI/CD pipelines.

India

Message

What I'm looking for

I’m looking for a remote-friendly team where I can lead QA automation and engineering systems—especially GenAI/LLM testing with reliable CI/CD, quality gates, observability, and measurable execution outcomes.

I’m a Senior QA automation engineer with 5+ years of experience delivering quality-driven software through scalable engineering systems and test automation. I build end-to-end frameworks in TypeScript/JavaScript and Python using Playwright/Puppeteer, integrating them into CI/CD via GitHub Actions and Azure DevOps to improve developer productivity, pipeline reliability, and release confidence.

My work goes beyond traditional testing: I’ve built production-grade GenAI evaluation services in Python with DeepEval (GEval and DAG-based custom metrics), exposed via FastAPI and deployed as a Dockerized CI sidecar alongside Playwright. I also designed FlakyGuard for AI-powered Playwright reporter-based flaky test root-cause analysis and auto-quarantine, and I strengthen quality with API/contract testing, telemetry-driven observability (Allure and success metrics), and performance testing using k6—backed by quality gates and gated check-ins that prevent defect escapes.

Experience

Work history, roles, and key accomplishments

Current

Senior QA Automation Engineer

Current

Cyndx

Jan 2025 - Present (1 year 5 months)

Designed scalable Playwright (TypeScript, POM) test automation for UI and API coverage to support reliable release cycles. Built a Python DeepEval-based LLM evaluation FastAPI service (Dockerized CI sidecar) with custom GEval/DAG metrics for five quality dimensions, plus telemetry-driven citation verification, regression detection, and flaky test auto-quarantine with Allure/Slack reporting.

Playwright TypeScript Python DeepEval DAGs fastAPI Docker Azure DevOps CI CD Allure Reporting

Software Development Engineer in Test

Think Future Technologies

Sep 2023 - Jan 2025 (1 year 4 months)

Developed and maintained JavaScript-based automation frameworks with Jest and Puppeteer for Salesforce UI and API testing to improve release reliability. Migrated CI/CD engineering systems from Jenkins to GitHub Actions using Azure-hosted runners and supported shift-left testing practices across global cross-functional teams.

JavaScript Jest Puppeteer Salesforce Testing GitHub Actions Azure DevOps Jenkins CI CD Test Strategy Code Review

Software Development Engineer in Test

Think Future Technologies

Aug 2023 - Sep 2023 (1 month)

Built Postman API test collections with JavaScript pre-run scripts and executed load testing suites to produce performance reports for stakeholders. Implemented Appium-based mobile automation integrated with BrowserStack and validated 500+ order syncs from an ERP system.

Postman JavaScript API Testing Load Testing Appium BrowserStack performance reporting Automation

Software Development Engineer in Test

Think Future Technologies

Oct 2020 - Jul 2023 (2 years 9 months)

Architected an end-to-end test automation framework from scratch using Playwright and JavaScript, and built REST API test suites with Postman for complex assertions and data validation. Integrated automated regression testing into Azure DevOps/Jenkins on every deployment with quality gates and compliance enforcement, including reusable test data and environment setup automation.