# Patrick User

Patrick User is a remote worker on Himalayas, Senior AI Content Evaluator & RLHF Specialist at Outlier / Scale AI, based in Kenya.

Source: https://himalayas.app/@patrickuser21

```text
AI evaluation engineer at Outlier / Scale AI who built RLHF workflows that reduced model hallucinations by 32%.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | Kenya |
| Authorized to work in | Kenya |
| Salary expectations | 30k+ USD |
| Job categories | AI Evaluation Engineer, Software Developer, Search Relevance Specialist, Data Annotator, Research Analyst, Software Analyst |
| Skills | AI Evaluation, LLM Evaluation, Reinforcement Learning from Human Feedback, Red Teaming, AI model evaluation, Benchmarking and Testing, Prompt Engineering, AI Safety, Bias Detection, Search Relevance, Data Annotation, Data Quality Assurance, Systematische Fehleranalyse, Workflow Automation, Testing Automation |

## About

```text
At Outlier / Scale AI, I evaluate LLM outputs against technical rubrics for code correctness, mathematical logic, instruction following, and safety. I built RLHF, preference-ranking, and red-teaming workflows in Python that reduced model hallucinations by 32%.

I also created automation scripts and text-parsing tools to support error analysis, document failure patterns, and prioritize fine-tuning for foundation-model releases. Across evaluation cycles, I identified edge-case failures and contributed to improved model accuracy on MMLU-Pro benchmark tasks.

At Braze, I implemented and maintained backend RESTful microservices and data integration pipelines using Python, SQL, and AWS. I automated QA workflows and backend integration tests, reducing the system defect rate by 35%.

At Appen, I evaluated search relevance and API responses, audited web application outputs, and identified bias, logic errors, and policy violations in generative AI training data. Earlier, at Nairobi Data Labs, I built SQL pipelines to validate data assumptions for modeling projects.
```

## Experience

### Senior AI Content Evaluator & RLHF Specialist (current)

Outlier / Scale AI. Jan 2024 - Present

```text
Evaluated 3,000+ LLM outputs weekly using technical rubrics for code correctness, mathematical logic, instruction following, and safety compliance. Built RLHF, preference ranking, and red-teaming workflows in Python to reduce model hallucinations by 32%.
```

Skills: Python, RLHF, Red-Teaming, LLM-assessment, Quality-Assurance, Automation, Error-Analysis, MMLU-Pro

### Software Developer

[Braze](https://himalayas.app/companies/braze). Jun 2023 - Sep 2024

```text
Implemented and maintained backend RESTful microservices and data integration pipelines in Python, SQL, and AWS. Automated QA workflows and backend integration tests, reducing system defect rate by 35%.
```

Skills: Python, SQL, AWS, REST-APIs, Microservices, QA-Automation, Git, Agile

### Search Relevance & Data Annotation Specialist

[Appen](https://himalayas.app/companies/appen). Dec 2021 - Apr 2023

```text
Evaluated search relevance algorithms and API responses across 4,500+ query-result pairs annually, maintaining 98%+ consistency. Conducted data-accuracy audits and built Python automation scripts to improve edge-case throughput by 20%.
```

Skills: Python, Data-Annotation, Search-Relevance, Quality-Assurance, Fact-Checking, Automation

### Junior Research and Software Analyst

Nairobi Data Labs. Jan 2021 - Dec 2021

```text
Built SQL pipelines to validate data assumptions for modeling projects and accelerated research delivery through systematic quality control audits.
```

Skills: SQL, Data-Validation, Quality-Control, Research

## Education

### Jomo Kenyatta University of Agriculture and Technology

Bachelor of Science, Mathematics and Computer Science

```text
Graduated with a BSc in Mathematics and Computer Science in 2023.
```

### Google

Google Cloud AI, Artificial Intelligence

```text
Completed the Google Cloud AI certification.
```

### AWS

AWS ML Foundation, Machine Learning

```text
Completed the AWS ML Foundation certification.
```

### University of Maryland Global Campus

Postgraduate Diploma, Cloud Computing & Systems Architecture

```text
Completed a Postgraduate Diploma in Cloud Computing & Systems Architecture in 2025.
```

## Tech stack

- Amazon EC2
- Amazon S3
- MySQL
- PostgreSQL
- Node.js
- JavaScript
- Python
- Grafana
- AWS Lambda
- Git
- Docker
- SQL
- Google Colab
- JAX
- AWS

To contact Patrick, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Frankline Mutuma](https://himalayas.app/@franklinemutuma): AI Rater / Evaluator, Telus International
- [ELVIS MAINA](https://himalayas.app/@3lvoh): AI Training & Video Analytics, Independent Projects
- [Bahati Kambi](https://himalayas.app/@bahatikambi): AI Data Trainer & Specialist, Independent
- [John Wangechi](https://himalayas.app/@johnwangechi): AI Evaluation Specialist, Micro1
- [Jimmy Tole](https://himalayas.app/@jimmytole): AI & Software Evaluation Specialist, Freelance
- [Leaky Barak](https://himalayas.app/@leakybarak1): AI Evaluation Analyst / Machine Learning Engineer, Defined.ai
- [Peter Ngavi Ngavu](https://himalayas.app/@peterngavingavu): Graduate Teaching & Research Assistant, University of Nairobi
- [Geoffrey Kamondo](https://himalayas.app/@geoffreykamondo): AI Research Specialist and Machine Learning Engineer, Various AI Research Platforms
- [Miles Mailo](https://himalayas.app/@milesmailo): Remote AI Trainer & Data Evaluator, Independent Contractor
- [MUCHERU PIUS MACHARIA](https://himalayas.app/@mucherupiusmacharia): Senior Data Annotation Specialist, Remote AI Data Projects