Looking for a job

Steven Conboy

@stevenconboy

Message

I build QA strategies and evaluation frameworks for agentic AI, RAG systems, and enterprise software.

Canada

Message

What I'm looking for

I'm looking to lead QA strategy and AI evaluation work for agentic and retrieval-backed systems, helping teams adopt AI-assisted testing while building reliable, safe products.

At OpenText, I develop test strategy for Aviator Kernel Services, an agentic AI solution spanning agent registries, templates, A2A gateways, and MCP server integration.

I architect answer-quality evaluation frameworks for RAG pipelines, reasoning engines, summarization, and multi-step queries. My work measures groundedness, relevance, truthfulness, hallucination risk, safety, bias, toxicity, PII leakage, and prompt-injection vulnerabilities.

I champion GitHub Copilot adoption across QA workflows, mentor teams on AI-assisted test development, and automate end-to-end testing with Playwright and Pytest.

Earlier, I applied rigorous QA to ALMA observatory data and software, supporting scientific discoveries including black hole imaging and observations of planet-forming regions. I also bring enterprise testing experience from Imagine Communications and Powernoodle.

Experience

Work history, roles, and key accomplishments

Current

Lead Quality Assurance Developer

Current

OpenText

Jan 2022 - Present (4 years 8 months)

Develops test strategy for Aviator Kernel Services, an agentic AI solution, and champions Copilot adoption across QA workflows. Designs scenario-based evaluation suites and automates E2E tests using Playwright and Pytest.

Playwright Pytest API Testing E2E Testing RAG AI Evaluation Copilot Test Strategy

Senior QA Engineer

Imagine Communications

Jan 2019 - Jan 2022 (3 years)

Performed integration testing of timing generators and developed performance test plans with metrics recording. Maintained test automation infrastructure and received the Believe Award.

Integration Testing Performance Testing Testing Automation Regression Testing

Lead QA Engineer

Powernoodle Inc.

Jan 2018 - Jan 2019 (1 year)

Developed a comprehensive regression test plan and performed feature and regression testing.

Regression Testing Feature Testing Test Planning

Test Engineer

ALMA Observatory

Jan 2009 - Jan 2018 (9 years)

Applied rigorous QA to astronomical data and software, contributing to groundbreaking discoveries. Developed APIs to automate observation workflows and performed data quality assurance.

Data Quality Assurance API Development Testing Automation Astronomical Data

Research Assistant

Queen's University

Jun 2004 - Aug 2004 (2 months)

Conducted research for the Sudbury Neutrino Observatory and operated detector systems.

Research Detector Systems Physics

Education

Degrees, certifications, and relevant coursework

University of Toronto Rotman School of Management

Certification, Generative AI for Business

2024 - 2024

Completed Generative AI for Business certification from UofT Rotman in 2024.

University of British Columbia

M.Sc, Physics

2005 - 2007

Grade: 4.0 GPA

Activities and societies: Dean's Honor List

M.Sc in Physics from the University of British Columbia, 2005-2007. Dean's Honor List with a 4.0 GPA.

Queen's University

B.Sc Honors, Physics (Astrophysics)

2001 - 2005

Grade: 4.0 GPA

Activities and societies: Dean's Honor List, Principal's Scholarship

B.Sc Honors in Physics (Astrophysics) from Queen's University, 2001-2005. Dean's Honor List with a 4.0 GPA and Principal's Scholarship.

DeepLearning.AI

Certification, Prompt Engineering, LangChain

Completed certifications in Prompt Engineering and LangChain from DeepLearning.AI.

OpenAI

Certification, AI and LLM Applications

Completed certifications in Building and Evaluating Advanced RAG Applications, MCP: Build Rich-Context AI Apps with Anthropic, Knowledge Graphs for RAG, Attention in Transformers, Building Generative AI Applications with Gradio, and Quality and Safety for LLM Applications.