Skip to main content
HimalayasHimalayas logo
keith monariKM
Open to opportunities

keith monari

@keithmonari

I specialize in LLM evaluation and AI red-teaming to surface safety risks and strengthen deployment guardrails.

Zimbabwe
Message

What I'm looking for

I’m looking for a remote role where I can lead LLM safety evaluations—building red-teaming scenarios, eval harnesses, and multimodal datasets—while partnering with technical and product teams to turn model risks into measurable guardrails.

I’m an AI safety and evaluation specialist with 5+ years of hands-on experience in adversarial prompt design, LLM red-teaming, and large-scale data annotation. I focus on uncovering model failure modes—hallucinations, policy violations, and unsafe outputs—then turning findings into practical mitigation guidance.

I build structured eval harnesses and safety intelligence reporting using OWASP LLM Top 10 and MITRE ATLAS. In remote roles, I’ve designed realistic red-teaming prompt and scenario sets by researching real-world threat actor behaviors and crafting culturally and linguistically diverse inputs for robust global evaluation.

I also support end-to-end dataset quality through multimodal annotation and QA workflows (text, image, audio, and video), leveraging tools like CVAT and V7 Labs. I communicate clearly across technical and product teams, maintain rigorous documentation for reproducible work, and continuously improve annotation and evaluation processes.

Experience

Work history, roles, and key accomplishments

HA
Current

AutoCAD Mechanical Specialist

Handshake AI

Mar 2026 - Present (3 months)

Recorded structured AutoCAD Mechanical workflow demonstrations to generate training data for AI model development. Produced reproducible 2D/3D modeling, drawing analysis, and edited design demonstrations with detailed narration and consistent documentation.

AF
Current

Gen AI Analyst

Active Fence

Nov 2025 - Present (7 months)

Designed multi-modal adversarial prompts to stress-test LLM deployments and uncover policy violations, hallucinations, and unsafe outputs. Documented model weaknesses using OWASP LLM Top 10 and MITRE ATLAS to support mitigation and guardrail strategy, while contributing to annotation and QA of training data.

EA
Current

AI Data Annotator

ERUD AI

Sep 2025 - Present (9 months)

Annotated and reviewed NLP and computer-vision data using CVAT and V7 Labs. Ensured compliance with data privacy requirements while meeting tight delivery deadlines.

LD
Current

AI Data Annotator

Label Your Data

Mar 2024 - Present (2 years 3 months)

Annotated computer-vision datasets in CVAT using key points, polygons, and bounding box styles. Partnered with QA teams to ensure annotation accuracy met client specifications.

RA

AI Data Annotator

RWS AI

Aug 2025 - Sep 2025 (1 month)

Performed cross-modal dataset annotation across text, images, audio, and video to support LLM and computer-vision training. Delivered validated datasets with text categorization, image segmentation, audio transcription, and NER work completed with global team collaboration.

CS

Freelance Transcriber & Image Annotator

Crowd Surf

Aug 2021 - Dec 2024 (3 years 4 months)

Transcribed an average of 100 HITs/day with 98%+ accuracy and captioned/synchronized video and audio content. Annotated datasets for media companies using CVAT, Adobe Photoshop, and V7 Labs.

BC

Civil Engineering Attachee

Batch JV Rhines Consultants

Jun 2024 - Aug 2024 (2 months)

Assisted in design and drafting of road, water supply, and sewerage infrastructure projects. Supported site surveys, design drawings, cost estimation, and technical documentation.

LA

Image Annotator

LXT AI

Aug 2023 - Jul 2024 (11 months)

Annotated computer-vision data for object detection, segmentation, classification, and tracking using CVAT plus Word and Excel. Provided technical feedback to improve annotation tools and processes.

Education

Degrees, certifications, and relevant coursework

Jomo Kenyatta University of Agriculture and Technology logoJT

Jomo Kenyatta University of Agriculture and Technology

Bachelor of Science, Civil Engineering

2021 -

Pursuing a Bachelor of Science in Civil Engineering. Final year project analyzed the effect of increased high-rise construction on urban water supply using GIS and EPANET to model demand growth and pressure variations.

Find your dream job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan