Skip to main content
LB
Looking for a job

Leaky Barak

@leakybarak1

AI Evaluation Analyst at Defined.ai who evaluates LLMs and builds frameworks for consistent assessment.

Kenya
Message

At Defined.ai, I evaluate large language models and design frameworks, annotation guidelines, and scoring rubrics for consistent assessment. I analyze model responses for factual errors, reasoning failures, and other weaknesses, then share recommendations to support refinement.

Previously, I developed machine learning data workflows at AfterQuery and evaluated AI outputs at Scale AI and Appen. Across these roles, I’ve benchmarked models, reviewed dataset quality, and contributed to clearer evaluation standards and more reliable AI systems.

Experience

Work history, roles, and key accomplishments

DE
Current

AI Evaluation Analyst / Machine Learning Engineer

Jun 2025 - Present (1 year 5 months)

Evaluates large language models and AI systems across reasoning, factual accuracy, instruction following, and response quality. Designs evaluation frameworks, annotation guidelines, and scoring rubrics, and performs benchmark testing and error analysis.

Education

Degrees, certifications, and relevant coursework

United States International University – Africa (USIU-Africa) logoUU

United States International University – Africa (USIU-Africa)

Bachelor of Science, Artificial Intelligence

2017 - 2021

Completed a comprehensive undergraduate program focused on artificial intelligence, machine learning, computational systems, and software development.

DeepLearning.AI logoDE

DeepLearning.AI

Machine Learning Specialization, Machine Learning

Completed the Machine Learning Specialization, covering supervised and unsupervised learning, model evaluation, and validation methods.

DeepLearning.AI logoDE

DeepLearning.AI

Generative AI with Large Language Models, Generative AI

Completed the Generative AI with Large Language Models course, covering LLM fundamentals, prompt engineering, and evaluation techniques.

Tech stack

Software and tools used professionally

Availability

Looking for a job

Location

Kenya

Authorized to work in

Salary expectations

60k+ USD

Skills

Large Language Model (LLM) Evaluation
AI Benchmarking
Model Validation
Evaluation Framework Design
Error AnalysisData Quality Assessment
Annotation Guidelines Development
AI Analysis
Human Feedback Evaluation
Statistical Analysis
Benchmarking and Testing
Quality AssuranceNatural Language ProcessingGenerative AIHuman In The Loop (HITL) Systems

Interested in hiring Leaky?

You can contact Leaky and 600K+ other talented remote workers on Himalayas.

Message Leaky

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan