Skip to main content
Talha ZafarTZ
Looking for a job

Talha Zafar

@talhazafar3

AI Infrastructure & DevOps Engineer at Augai.ai running production vLLM inference on multi-GPU systems and scaling GPU compute with RunPod.

Pakistan
Message

At Augai.ai, I operate the production LLM inference platform for codsy.ai, serving Qwen2.5-Coder-32B and DeepSeek-R1-Distill-7B on multi-GPU infrastructure. I also built a FastAPI router for distributing inference traffic across GPU workers and a custom parser plugin to resolve tool-calling failures.

I designed a hybrid GPU architecture with a bare-metal orchestrator and ephemeral RunPod compute workers. I’m the sole owner of the production infrastructure, including its Kubernetes cluster, developer containers, and monitoring.

At BoolMind, I architected APIs and microservices for Manage My Dojo, adding real-time notifications with Redis Pub/Sub and WebSockets. Delivering a robust beta contributed to a 25% increase in investor interest.

Earlier, at Techleadz, I built backend APIs and encryption services, and contributed to a Nextcloud file-management system. I began my career as a Machine Learning Intern at Technocolabs Softwares, contributing to supervised learning models and data-preprocessing pipelines.

Experience

Work history, roles, and key accomplishments

AU
Current

AI Infrastructure & DevOps Engineer

Augai.ai

Jan 2026 - Present (10 months)

Deployed and operate a production LLM inference platform on multi-GPU hardware using vLLM, with custom load balancing and hybrid serverless GPU scaling. Own production infrastructure including Kubernetes, CI/CD pipelines, and security monitoring.

TS

Machine Learning Intern

Technocolabs Softwares

Jul 2022 - Aug 2022 (1 month)

Contributed to supervised learning model development and data preprocessing pipelines in Python as part of a structured ML internship.

Education

Degrees, certifications, and relevant coursework

National University of Computer and Emerging Sciences (FAST-NUCES) logoNF

National University of Computer and Emerging Sciences (FAST-NUCES)

Bachelor of Science, Computer Science

Bachelor of Science in Computer Science from the National University of Computer and Emerging Sciences (FAST-NUCES).

IT

iTechnet

DevSecOps, DevSecOps

Completed the DevSecOps certification from iTechnet.

Amazon Web Services logoAS

Amazon Web Services

AWS AI Practitioner Challenge, AI Practitioner

Completed the AWS AI Practitioner Challenge from Amazon Web Services.

Interested in hiring Talha?

You can contact Talha and 600K+ other talented remote workers on Himalayas.

Message Talha

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan