keith monari
@keithmonari
I specialize in LLM evaluation and AI red-teaming to surface safety risks and strengthen deployment guardrails.
What I'm looking for
I’m an AI safety and evaluation specialist with 5+ years of hands-on experience in adversarial prompt design, LLM red-teaming, and large-scale data annotation. I focus on uncovering model failure modes—hallucinations, policy violations, and unsafe outputs—then turning findings into practical mitigation guidance.
I build structured eval harnesses and safety intelligence reporting using OWASP LLM Top 10 and MITRE ATLAS. In remote roles, I’ve designed realistic red-teaming prompt and scenario sets by researching real-world threat actor behaviors and crafting culturally and linguistically diverse inputs for robust global evaluation.
I also support end-to-end dataset quality through multimodal annotation and QA workflows (text, image, audio, and video), leveraging tools like CVAT and V7 Labs. I communicate clearly across technical and product teams, maintain rigorous documentation for reproducible work, and continuously improve annotation and evaluation processes.
Experience
Work history, roles, and key accomplishments
AutoCAD Mechanical Specialist
Handshake AI
Mar 2026 - Present (3 months)
Recorded structured AutoCAD Mechanical workflow demonstrations to generate training data for AI model development. Produced reproducible 2D/3D modeling, drawing analysis, and edited design demonstrations with detailed narration and consistent documentation.
Gen AI Analyst
Active Fence
Nov 2025 - Present (7 months)
Designed multi-modal adversarial prompts to stress-test LLM deployments and uncover policy violations, hallucinations, and unsafe outputs. Documented model weaknesses using OWASP LLM Top 10 and MITRE ATLAS to support mitigation and guardrail strategy, while contributing to annotation and QA of training data.
AI Data Annotator
Mercor AI
Oct 2025 - Present (8 months)
Labeled and validated large-scale datasets for AI model training using V7 Labs and proprietary tools. Applied QA protocols to improve annotation accuracy and collaborated on annotation tool workflow optimization.
AI Data Annotator
ERUD AI
Sep 2025 - Present (9 months)
Annotated and reviewed NLP and computer-vision data using CVAT and V7 Labs. Ensured compliance with data privacy requirements while meeting tight delivery deadlines.
AI Data Annotator
Label Your Data
Mar 2024 - Present (2 years 3 months)
Annotated computer-vision datasets in CVAT using key points, polygons, and bounding box styles. Partnered with QA teams to ensure annotation accuracy met client specifications.
AI Data Annotator
RWS AI
Aug 2025 - Sep 2025 (1 month)
Performed cross-modal dataset annotation across text, images, audio, and video to support LLM and computer-vision training. Delivered validated datasets with text categorization, image segmentation, audio transcription, and NER work completed with global team collaboration.
Freelance Transcriber & Image Annotator
Crowd Surf
Aug 2021 - Dec 2024 (3 years 4 months)
Transcribed an average of 100 HITs/day with 98%+ accuracy and captioned/synchronized video and audio content. Annotated datasets for media companies using CVAT, Adobe Photoshop, and V7 Labs.
Freelance Transcriber
Casting Words
Feb 2021 - Nov 2024 (3 years 9 months)
Worked as a transcriber across business, health, and education domains and was promoted to Senior Transcriber and Senior Editor based on consistent accuracy and quality. Delivered edited transcripts to project standards.
Civil Engineering Attachee
Batch JV Rhines Consultants
Jun 2024 - Aug 2024 (2 months)
Assisted in design and drafting of road, water supply, and sewerage infrastructure projects. Supported site surveys, design drawings, cost estimation, and technical documentation.
Image Annotator
LXT AI
Aug 2023 - Jul 2024 (11 months)
Annotated computer-vision data for object detection, segmentation, classification, and tracking using CVAT plus Word and Excel. Provided technical feedback to improve annotation tools and processes.
Education
Degrees, certifications, and relevant coursework
Jomo Kenyatta University of Agriculture and Technology
Bachelor of Science, Civil Engineering
2021 -
Pursuing a Bachelor of Science in Civil Engineering. Final year project analyzed the effect of increased high-rise construction on urban water supply using GIS and EPANET to model demand growth and pressure variations.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring keith?
You can contact keith and 90k+ other talented remote workers on Himalayas.
Message keithFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
