Open to opportunities

Usman Shahid

@usmanshahid1

Senior QA Automation Engineer specializing in performance/load testing and AI/LLM validation for high-stakes fintech systems.

Pakistan

Message

What I'm looking for

I’m looking for a role where I can own performance/load testing and AI/LLM validation for LLM-powered products—building reliable automation, gating quality with measurable evaluation, and collaborating cross-team to deliver predictable releases.

I’m a Senior QA Automation Engineer with 6+ years specializing in performance/load testing, AI/LLM validation, and high-stakes fintech systems. I build k6-based load testing and LLM evaluation programs for chatbot and LLM-powered platforms—targeting 1,000–10,000 concurrent conversations—and validate outcomes with 94% accuracy for AI applications.

In my work, I combine structured, risk-based testing with hands-on automation using Playwright, Appium, JavaScript, and Python, plus observability through Grafana and AWS. I’ve reduced critical production defects by 85%, improved regression testing from 12 to 3 hours per sprint (75% reduction), and led QA efforts that achieved a 98% pre-release defect resolution rate, while coordinating cross-team delivery with predictable release outcomes.

Experience

Work history, roles, and key accomplishments

Current

Senior QA Automation Engineer

Current

Kualimate

Apr 2026 - Present (3 months)

Owned end-to-end load and performance testing for an LLM-powered virtual agent platform, scaling from 1,000+ to 10,000 concurrent conversations. Built a k6-based load framework and a Python evaluation pipeline with prompt/injection and hallucination robustness gating, plus Grafana dashboards.

Load Testing Performance Testing JavaScript Time To First Token (TTFT)Python LLM Evaluation Hallucination Detection Response Coherence Scoring Pass Fail Gating Redis Pub Sub S3 Grafana Synthetic Customer Fleet

Senior Software QA Engineer

Coding Cops

Jan 2025 - Apr 2026 (1 year 3 months)

Led a team of 12 QA engineers across multiple projects including an AI influencer marketing platform and LLM/chatbot applications. Designed semantic search, LLM validation, and chatbot testing frameworks, and delivered Playwright/Appium automation that reduced regression time from 12 to 3 hours per sprint.

QA Leadership Test Framework Semantic Search AI Validation Playwright Appium MCP Scrapfly UI Testing RBAC Exploratory testing Defect Triage Security Testing

Software Quality Assurance Engineer

Techverx

Nov 2022 - Dec 2024 (2 years 1 month)

Ensured quality across multiple enterprise applications including an investment management platform and debt/POS/music streaming systems, maintaining zero critical production defects over 18 consecutive months. Executed 1,200+ test cases per quarter and performed Postman API testing for 30+ endpoints across payment and financial integrations.

Test Planning Boundary Value Analysis API Testing Postman Performance Testing Payment Integration

Software Quality Assurance Engineer

Leapsofts

Jan 2021 - Oct 2022 (1 year 9 months)

Delivered QA for eight e-commerce projects with $2M+ combined monthly revenue, covering payment gateways, checkout flows, and inventory management. Conducted cross-browser/device testing and usability testing, and resolved 25+ payment integration bugs before launch.

E Commerce Testing Payment Testing Stripe PayPal Checkout Flow Cross Browser Testing Usability Testing