Skip to main content
humza noorHN
Looking for a job

humza noor

@humzanoor

LLM Developer at Brio designing evaluation scenarios and prompt templates for LLM agents.

Pakistan
Message

At Brio, I design multihop evaluation scenarios for TAU, a benchmark for assessing reasoning and tool use in LLM agents. I also author Structured Prompt Templates that support repeatable task formulation across workflows such as Google Workspace, Jira, and Zendesk.

I apply Structured Prompt Design to create consistent agent instructions, balancing natural-language clarity with API-call precision. I also build and validate gold-standard trajectories for supervised fine-tuning and RLHF-style comparisons.

Previously, as a Software Engineer at Nymble Leap, I developed applications, created data pipelines, and worked on GenAI projects. My work there combined Python development with web development and data science.

At Brio, I also worked as an LLM Training Specialist, training and evaluating models on coding problems based on resolved GitHub issues and merged branches. I’m interested in sports analytics, event-driven architectures, and real-time streaming systems.

Experience

Work history, roles, and key accomplishments

Brio logoBR
Current

LLM Developer

Brio

Jun 2025 - Present (1 year 5 months)

Technologies: Python, Google Colab, Google Workspace APIs (Sheets, Docs, Drive), Jira, Zendesk, Markdown

Domains: RLHF, Structured Prompt Design (SPD), Structured Prompt Templates (SPT)

Responsibilities:

• Designed real-world, multihop evaluation scenarios for TAU — a benchmark for assessing reasoning and tool-use capabilities in LLM agents.
• Authored Structured Prompt Templates (SPT) enabling

NL

Software Engineer

Nymble Leap

Jul 2023 - Jun 2025 (1 year 11 months)

Working as a Python developer in web development and data science. Developing applications, creating data pipelines and working with GenAI projects.

Brio logoBR

LLM Training Specialist

Brio

Mar 2025 - Apr 2025 (1 month)

Worked with a foreign client to train and test different coding problems on an LLM. Multiple LLMs were being pitched against one another to analyze the responses and studying the line of thought and execution cycles of the models.
The domain of training and evaluting the models, was based around resolved GitHub issues with corresponding merged branches. Repositories were cloned and code was analyz

Appalo Inc logoAI

Business Analyst

Appalo Inc

Mar 2023 - Apr 2023 (1 month)

• Analyzed system workflows to design efficient data integration frameworks.
• Assisted in defining data validation logic and backend flow documentation.
• Developed clear models for cross-system communication and tracking.

The Dev Corporate logoTC

Project Management Intern

The Dev Corporate

Feb 2023 - Mar 2023 (1 month)

Worked as Project Management Intern at The Dev Corporate.

SC

Content Head

Stacks FAST Chapter

Nov 2021 - Feb 2023 (1 year 3 months)

Worked as Content Head at Stacks FAST Chapter.

CF

Manager Content Writing

Career Counseling Society FAST-NU

Jul 2021 - Jul 2022 (1 year)

Worked as Manager Content Writing at Career Counseling Society FAST-NU .

SC

Founding Partner

Stacks FAST Chapter

Nov 2021 - Dec 2021 (1 month)

Worked as Founding Partner at Stacks FAST Chapter.

CF

Content Team Member

Career Counseling Society FAST-NU

Jul 2020 - Jul 2021 (1 year)

Worked as Content Team Member at Career Counseling Society FAST-NU .

Education

Degrees, certifications, and relevant coursework

MI

Microsoft

Career Essentials in Generative AI by Microsoft and LinkedIn

Jun 2026

LI

LinkedIn

Automation Using Python

Jul 2024

MC

McKinsey & Company

McKinsey Forward Program

Jul 2024

LI

LinkedIn

Level Up: Python

Aug 2024

LI

LinkedIn

Python Essential Training

Jul 2024

National University of Computer and Emerging Sciences logoNS

National University of Computer and Emerging Sciences

Computer Science, Computer Science

2019 - 2023

KA

Kaggle

Python

Jul 2023

KA

Kaggle

Data Visualization

Aug 2023

PC

Punjab Group of Colleges

FSc (Pre-engineering), Engineering

2017 - 2019

Interested in hiring humza?

You can contact humza and 600K+ other talented remote workers on Himalayas.

Message humza

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan