Skip to main content
Fabian MuneneFM
Looking for a job

Fabian Munene

@fabianmunene

AI Quality Engineer at TAVILY AI who evaluates LLM responses and improves annotation workflows for reliable conversational AI.

Kenya
Message

At TAVILY AI, I evaluate AI-generated responses for technical correctness, factual accuracy, reasoning quality, and policy compliance. I also review advertiser-AI conversations and validate campaign recommendations across the marketing funnel.

I create structured annotation feedback and reusable prompt libraries to support consistent model evaluation. My work includes documenting annotation standards and collaborating with research, product, and engineering teams on evaluation methods.

At TWENTYAI, I developed and optimized prompts for enterprise LLM applications, then reviewed and annotated model outputs using structured frameworks. At MOSAIC AI, I audited training datasets, investigated annotation errors, and contributed to improvements in evaluation frameworks.

At CONTIVIO AI, I implemented conversational AI solutions across voice, chat, SMS, and messaging platforms. I also designed AI workflows and knowledge retrieval systems, and configured and validated agents before production deployment.

Experience

Work history, roles, and key accomplishments

TA
Current

Senior AI Quality & LLM Evaluation Engineer

Tavily AI

May 2023 - Present (3 years 5 months)

Evaluated thousands of AI-generated responses for technical correctness, factual accuracy, reasoning quality, and policy compliance. Identified hallucinations and logical inconsistencies, and produced structured annotation feedback to improve model performance.

Education

Degrees, certifications, and relevant coursework

University of Nairobi logoUN

University of Nairobi

Master of Science (M.S.), Computer Science

2017 - 2019

Master of Science in Computer Science from the University of Nairobi, completed in 2019.

University of Nairobi logoUN

University of Nairobi

Bachelor of Science (B.S.), Computer Science

2012 - 2016

Bachelor of Science in Computer Science from the University of Nairobi, completed in 2016.

IBM logoIB

IBM

IBM Data Science Professional Certificate, Data Science

Professional certificate in Data Science from IBM.

Google logoGO

Google

Google Professional Machine Learning Engineer, Machine Learning

Professional certification as a Machine Learning Engineer from Google.

TensorFlow logoTE

TensorFlow

TensorFlow Developer Certificate, Machine Learning

Developer certificate in TensorFlow.

Microsoft logoMI

Microsoft

Microsoft Azure AI Fundamentals, Artificial Intelligence

Fundamentals certification in Azure AI from Microsoft.

Amazon Web Services (AWS) logoAA

Amazon Web Services (AWS)

AWS Certified Machine Learning – Specialty, Machine Learning

Certified Machine Learning – Specialty from AWS.

CC

Certified Analytics Professional (CAP)

Certified Analytics Professional (CAP), Analytics

Professional certification in analytics.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan