Umair Baig
@umairbaig1
AI Program Manager specializing in production GenAI operations and LLM quality evaluation.
What I'm looking for
I’m a programme and project management leader with 13+ years delivering complex initiatives across enterprise consulting, technology, and global creative operations—now fully specialized in production GenAI programme management.
At Puntt AI, I govern the AI quality and operations layer by deploying LLM output evaluation, inter-rater reliability (IRR) frameworks, eval pipelines, and reviewer calibration systems that sustain Fortune 500 AI deployments at 99.7–100% accuracy at enterprise scale.
I combine structured delivery discipline with hands-on production AI expertise, including HITL system design, AI failure taxonomy and triage, and SOP development. I also drive real-time studio performance governance using live performance tracking and weekly detect-and-recalibrate methodology to surface quality deviations before they reach the customer.
I build the operational foundations too: OKR cycles, North Star metric tracking, reviewer calibration loops, and studio health dashboards—creating real-time visibility for leadership where none previously existed. Alongside this, I lead globally distributed reviewer teams and maintain evidence-based handoffs that translate reviewer signal and customer feedback into precise product improvements.
Experience
Work history, roles, and key accomplishments
AI Program Manager
Puntt AI
Jan 2025 - Present (1 year 6 months)
Govern end-to-end AI programme operations for Fortune 500 accounts, owning LLM output evaluation, reviewer calibration, SLA governance, and eval pipeline architecture. Improved studio accuracy from 92.7% to a sustained 99.7–100% and helped achieve a 0.9% customer defect escape rate through internal catch mechanisms.
Program Manager
HTPL
Jan 2024 - Jan 2025 (1 year)
Led cross-functional teams delivering multiple strategic programmes with numerous sub-projects on time and within budget. Partnered with business leadership to set priorities based on resource capacity, risk exposure, and business value and built strategic plans, milestones, and logistics workflows.
Project Manager
Ingenuity Gaming
Nov 2021 - Aug 2023 (1 year 9 months)
Led multiple software-development projects with globally distributed teams, owning end-to-end delivery from pre-sales to release. Drove Scrum execution including backlog grooming, sprint planning, KPIs, feature demos, and feature testing, while managing plans, schedules, budgets, and delivery dashboards.
Created financial dashboards, budgets, and forecasts tracking performance against time, cost, and quality metrics. Led programme and project teams to deliver within allocated budgets, timelines, and quality expectations using Scrum methodologies and supported proposal development with sales by identifying and mitigating risks.
Project Manager
Livspace
Sep 2017 - Aug 2020 (2 years 11 months)
Owned end-to-end project delivery aligned with senior leadership’s strategic growth initiatives. Managed development and implementation of an enterprise ERP system and led a digital transformation programme coordinating architects, developers, and QA, while maintaining project charters, schedules, and RAID logs and managing change.
Supervised multiple projects from kickoff through delivery by prioritising needs and delegating assignments across teams. Coordinated across departments to keep stakeholders aligned on status, dependencies, and changes while maintaining schedules and adjusting workflows to stay on track.
Education
Degrees, certifications, and relevant coursework
Indian Institute of Management
Executive Post Graduate, Strategy Management
2019 - 2020
Completed an Executive Post Graduate programme in Strategy Management.
Visvesvaraya Technological University
Bachelor of Engineering, Engineering
2008 - 2012
Completed a Bachelor of Engineering degree.
Availability
Location
Authorized to work in
Website
umairbaig.workSocial media
Job categories
Skills
Interested in hiring Umair?
You can contact Umair and 90k+ other talented remote workers on Himalayas.
Message UmairGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
