Skip to main content
IU
Open to opportunities

Irfan Ullah

@irfanullah5

AI Operations and data annotation specialist delivering high-quality LLM evaluation, RLHF alignment, and search relevance.

Pakistan
Message

What I'm looking for

I’m looking for AI operations and data annotation work where I can run large-scale dataset pipelines, perform search evaluation and RLHF response checks, and improve LLM performance with rigorous QA on production workflows.

I’m an AI Operations and Data Annotation Specialist with 5 years of professional experience executing high-quality data annotation, complex search relevancy diagnostics, and large-scale dataset management. I’m known for Search Engine Evaluation, multi-lingual acoustic transcription, and optimizing LLM performance alignment (RLHF) with sustained 98%+ verification metrics.

I steer production workflows on global crowdsourcing frameworks to deliver enterprise-grade data solutions. From LLM response evaluation and RLHF sequence annotations to dataset sanitization, integrity audits, and semantic filtering for content moderation and safety, I focus on accuracy, policy alignment, and continuous quality checks that eliminate production anomalies.

Experience

Work history, roles, and key accomplishments

FR
Current

AI Operations & Annotation

Freelance

Jan 2021 - Present (5 years 10 months)

Led end-to-end dataset creation and LLM response evaluation pipelines, including RLHF sequence annotations, supporting sustained 98%+ verification metrics. Conducted multi-lingual acoustic transcription and query-to-product search evaluation to improve relevancy baselines for production models.

FR

Digital Data & Linguistics Expert

Freelance

Jan 2019 - Jan 2021 (2 years)

Managed high-volume data ingestion and migration with zero-error validation compliance. Supervised dataset sanitization and linguistic integrity audits across large Urdu/Pashto/Hindi text corpora.

ExcelData MigrationQuality Control
Unstructured Data Management

Education

Degrees, certifications, and relevant coursework

BE

Board of Intermediate & Secondary Education

Intermediate in Computer Science, Computer Science

Completed Intermediate in Computer Science (ICS) awarded by the Board of Intermediate & Secondary Education, Pakistan.

Tech stack

Software and tools used professionally

Availability

Open to opportunities

Location

Pakistan

Authorized to work in

Skills

ExcelAI OperationsData AnnotationMachine LearningAI Response EvaluationRLHF PipelineReinforcement Learning
Structural Labeling
ClassificationSearch Evaluation
Product Mapping
Multi Lingual Acoustic Transcription
Audio Alignment
Phonetic Indexing
Data Integrity Specialist
Content Moderation
OneForma Platform
Telus International
CrowdGen (Appen)
Proz
UHRS Production Portal
Data Migration
Luel.Ai

Interested in hiring Irfan?

You can contact Irfan and 600K+ other talented remote workers on Himalayas.

Message Irfan

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan