Looking for a job

Khurram Sultan

@khurramsultan

Message

I build applied AI evaluation pipelines, benchmarks, synthetic data, and engineering organizations.

Pakistan

Message

What I'm looking for

I'm looking for fully remote applied AI R&D and engineering leadership work with US, EU, Gulf, or ANZ overlap, where I can build rigorous LLM evaluation, benchmark, and synthetic-data systems while leading teams and shipping production platforms.

I've led applied AI R&D for UK, EU, and US clients since 2021, building frontier LLM training and evaluation pipelines for agent trajectories, document intelligence, cross-document reasoning, synthetic data, and benchmark integrity.

I authored 45 verified model-breaking post-training tasks in 40 days, built FastAPI evaluation workflow tooling and browser extensions, and researched performance optimization across scikit-learn, scikit-image, NumPy, and Astropy. I also led an IWG plc modernization POC that won the development contract and delivered the first production microservices.

At ApexChat, now Blazeo, I grew an offshore engineering organization from 17 to 45 engineers, established DevOps and test automation functions, and cut release cycles from roughly three months to one. I'm a player-coach who builds organizations while continuing to ship.

Experience

Work history, roles, and key accomplishments

Current

Contract Engineering Leader / Consultant

Current

Applied AI R&D

Jan 2021 - Present (5 years 8 months)

Engineering leadership, architecture, and applied AI across full-time, single-client engagements. R&D engineering for frontier LLM training and evaluation pipelines, including agent trajectory analysis, document intelligence, reasoning dataset design, synthetic data generation, and benchmark integrity.

LLM Evaluation Training Data Agentic RAG GPT 4 Gemini Claude PyTorch Keras fastAPI Python Microservices Docker AWS Azure

Engineering Manager

ApexChat

Jan 2019 - Dec 2021 (2 years 11 months)

Headed the offshore engineering organization of a 500+ employee US live-chat company, reporting to CEO and CTO. Grew the organization from 17 to 45 engineers, restructured into 4 vertical teams, and drove chatbot automation and platform scaling initiatives.

Engineering Management Team Leadership DevOps Testing Automation Scrum Kanban Chatbot Automation Platform Scaling

Principal Software Architect

NetSol Technologies

Jan 2016 - Dec 2017 (1 year 11 months)

Partnered with the CTO on product specifications, technology selection, and coding standards. Provided architecture oversight and estimation support to delivery teams.

Architecture Technology Selection Coding Standards Estimation Product Specification