Skip to main content
Umair BaigUB
Open to opportunities

Umair Baig

@umairbaig1

AI Program Manager specializing in production GenAI operations and LLM quality evaluation.

India
Message

What I'm looking for

I’m looking to lead end-to-end production GenAI operations—owning LLM evaluation, HITL workflows, reviewer calibration, and governance—so engineering and leadership get reliable, measurable accuracy at scale with clear SOPs and dashboards.

I’m a programme and project management leader with 13+ years delivering complex initiatives across enterprise consulting, technology, and global creative operations—now fully specialized in production GenAI programme management.

At Puntt AI, I govern the AI quality and operations layer by deploying LLM output evaluation, inter-rater reliability (IRR) frameworks, eval pipelines, and reviewer calibration systems that sustain Fortune 500 AI deployments at 99.7–100% accuracy at enterprise scale.

I combine structured delivery discipline with hands-on production AI expertise, including HITL system design, AI failure taxonomy and triage, and SOP development. I also drive real-time studio performance governance using live performance tracking and weekly detect-and-recalibrate methodology to surface quality deviations before they reach the customer.

I build the operational foundations too: OKR cycles, North Star metric tracking, reviewer calibration loops, and studio health dashboards—creating real-time visibility for leadership where none previously existed. Alongside this, I lead globally distributed reviewer teams and maintain evidence-based handoffs that translate reviewer signal and customer feedback into precise product improvements.

Experience

Work history, roles, and key accomplishments

PA
Current

AI Program Manager

Puntt AI

Jan 2025 - Present (1 year 6 months)

Govern end-to-end AI programme operations for Fortune 500 accounts, owning LLM output evaluation, reviewer calibration, SLA governance, and eval pipeline architecture. Improved studio accuracy from 92.7% to a sustained 99.7–100% and helped achieve a 0.9% customer defect escape rate through internal catch mechanisms.

IG

Project Manager

Ingenuity Gaming

Nov 2021 - Aug 2023 (1 year 9 months)

Led multiple software-development projects with globally distributed teams, owning end-to-end delivery from pre-sales to release. Drove Scrum execution including backlog grooming, sprint planning, KPIs, feature demos, and feature testing, while managing plans, schedules, budgets, and delivery dashboards.

KPMG Global Services logoKS

Management Consultant

Sep 2020 - Nov 2021 (1 year 2 months)

Created financial dashboards, budgets, and forecasts tracking performance against time, cost, and quality metrics. Led programme and project teams to deliver within allocated budgets, timelines, and quality expectations using Scrum methodologies and supported proposal development with sales by identifying and mitigating risks.

LI

Project Manager

Livspace

Sep 2017 - Aug 2020 (2 years 11 months)

Owned end-to-end project delivery aligned with senior leadership’s strategic growth initiatives. Managed development and implementation of an enterprise ERP system and led a digital transformation programme coordinating architects, developers, and QA, while maintaining project charters, schedules, and RAID logs and managing change.

Education

Degrees, certifications, and relevant coursework

IM

Indian Institute of Management

Executive Post Graduate, Strategy Management

2019 - 2020

Completed an Executive Post Graduate programme in Strategy Management.

VU

Visvesvaraya Technological University

Bachelor of Engineering, Engineering

2008 - 2012

Completed a Bachelor of Engineering degree.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan