Skip to main content
Josbrian UdotoJU
Looking for a job

Josbrian Udoto

@josbrianudoto

AI Model Trainer at OneForma who evaluates LLM responses for factuality, reasoning, and safety.

Kenya
Message

At OneForma, I reviewed AI-generated responses for accuracy, relevance, safety, reasoning, and instruction compliance. I used project-specific scoring frameworks and wrote structured feedback to support model improvement.

I analyzed challenging outputs for hallucinations, contradictions, weak reasoning, bias, and edge-case failures. I also compared model responses through preference-ranking tasks supporting human feedback and reinforcement learning.

With TELUS International AI / UHRS / Toloka Programs, I assessed search relevance and ranking, classified online content, and contributed to A/B testing. A structured review and edge-case checking process I introduced helped lower review rejections by 20%.

At Scale AI, I annotated audio for speech recognition, speaker diarization, and intent classification, and produced computer vision labels. I maintained 98%+ accuracy on gold-standard tasks and helped reduce downstream QA rejections by 25% through validation and careful review.

Experience

Work history, roles, and key accomplishments

ON

Gen AI Model Trainer / AI Evaluation Specialist

OneForma

Jan 2023 - Sep 2026 (3 years 8 months)

Reviewed AI-generated responses and assigned quality scores based on accuracy, relevance, safety, tone, reasoning, and compliance. Analyzed model outputs to uncover hallucinations, contradictions, weak reasoning, bias, and edge-case failures.

TP

Search Specialist / AI Evaluator

TELUS International AI / UHRS / Toloka Programs

Jul 2023 - Dec 2024 (1 year 5 months)

Assessed search results for relevance and quality, classified content for misinformation and policy violations, and contributed to A/B testing and ranking evaluations. Introduced a structured review process that reduced review rejections by 20%.

RA

AI Data Annotator / Content Evaluator

RWS / Aligner

Worked on AI data projects involving response assessment, text annotation, ranking, and content-quality review. Applied project guidelines and quality standards when evaluating machine-generated content.

Education

Degrees, certifications, and relevant coursework

Kenyatta University logoKU

Kenyatta University

Bachelor of Science, Electrical and Electronics Engineering

2021 -

Pursuing a Bachelor of Science in Electrical and Electronics Engineering, with expected completion in 2026.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan