Skip to main content
Steven ConboySC
Looking for a job

Steven Conboy

@stevenconboy

I build QA strategies and evaluation frameworks for agentic AI, RAG systems, and enterprise software.

Canada
Message

What I'm looking for

I'm looking to lead QA strategy and AI evaluation work for agentic and retrieval-backed systems, helping teams adopt AI-assisted testing while building reliable, safe products.

At OpenText, I develop test strategy for Aviator Kernel Services, an agentic AI solution spanning agent registries, templates, A2A gateways, and MCP server integration.

I architect answer-quality evaluation frameworks for RAG pipelines, reasoning engines, summarization, and multi-step queries. My work measures groundedness, relevance, truthfulness, hallucination risk, safety, bias, toxicity, PII leakage, and prompt-injection vulnerabilities.

I champion GitHub Copilot adoption across QA workflows, mentor teams on AI-assisted test development, and automate end-to-end testing with Playwright and Pytest.

Earlier, I applied rigorous QA to ALMA observatory data and software, supporting scientific discoveries including black hole imaging and observations of planet-forming regions. I also bring enterprise testing experience from Imagine Communications and Powernoodle.

Experience

Work history, roles, and key accomplishments

ALMA Observatory logoAO

Test Engineer

ALMA Observatory

Jan 2009 - Jan 2018 (9 years)

Applied rigorous QA to astronomical data and software, contributing to groundbreaking discoveries. Developed APIs to automate observation workflows and performed data quality assurance.

Queen's University logoQU

Research Assistant

Queen's University

Jun 2004 - Aug 2004 (2 months)

Conducted research for the Sudbury Neutrino Observatory and operated detector systems.

Research
Detector Systems
Physics

Education

Degrees, certifications, and relevant coursework

University of Toronto Rotman School of Management logoUM

University of Toronto Rotman School of Management

Certification, Generative AI for Business

2024 - 2024

Completed Generative AI for Business certification from UofT Rotman in 2024.

University of British Columbia logoUC

University of British Columbia

M.Sc, Physics

2005 - 2007

Grade: 4.0 GPA

Activities and societies: Dean's Honor List

M.Sc in Physics from the University of British Columbia, 2005-2007. Dean's Honor List with a 4.0 GPA.

DeepLearning.AI logoDE

DeepLearning.AI

Certification, Prompt Engineering, LangChain

Completed certifications in Prompt Engineering and LangChain from DeepLearning.AI.

SA

SAFe

Certification, SAFe

Completed SAFe certification.

Udemy logoUD

Udemy

Certification, Management, AI for QA Engineers, Root Cause Analysis

Completed courses in Management, AI for QA Engineers, and Root Cause Analysis.

Queen's University logoQU

Queen's University

B.Sc Honors, Physics (Astrophysics)

2001 - 2005

Grade: 4.0 GPA

Activities and societies: Dean's Honor List, Principal's Scholarship

B.Sc Honors in Physics (Astrophysics) from Queen's University, 2001-2005. Dean's Honor List with a 4.0 GPA and Principal's Scholarship.

OpenAI logoOP

OpenAI

Certification, AI and LLM Applications

Completed certifications in Building and Evaluating Advanced RAG Applications, MCP: Build Rich-Context AI Apps with Anthropic, Knowledge Graphs for RAG, Attention in Transformers, Building Generative AI Applications with Gradio, and Quality and Safety for LLM Applications.

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan