Joel catlett
@joelcatlett
Generalist evaluator specializing in AI model testing, rubric design, and research synthesis.
What I'm looking for
I am a generalist evaluator with six years' experience designing rubrics and testing AI models for clarity, coherence, and factual accuracy. I combine research synthesis and instructional design to produce structured, actionable evaluation frameworks.
As a freelance consultant, I craft written content and research summaries for academic, business, and technical audiences while developing and testing prompts to improve AI outputs. I have hands-on experience grading model outputs across platforms such as ChatGPT, Claude, and Gemini.
In prior roles I supported faculty research through literature reviews, manuscript editing, and development of peer-review rubrics, improving assessment accuracy and consistency. I also provided individualized tutoring in writing and critical analysis, designing customized lesson plans and rubrics to strengthen argumentation and stylistic precision.
I seek roles where I can apply rigorous analytical benchmarks to refine AI performance and content quality, collaborate on structured benchmarking projects, and deliver clear, research-grounded feedback that supports product and instructional improvements.
Experience
Work history, roles, and key accomplishments
Freelance Writing & Research Consultant
Self-Employed
Jan 2022 - Present (3 years 10 months)
Produce tailored written content and research summaries and design rubrics and prompts to test and improve AI outputs for clarity, tone, and factual accuracy across academic and technical projects.
AI Trainer
Mercor
Oct 2025 - Nov 2025 (1 month)
Curated, annotated, and analyzed large datasets to refine AI models and improve system accuracy; developed evaluation processes to enhance machine learning algorithm performance.
Writing Instructor
Private Tutoring
Aug 2020 - Dec 2021 (1 year 4 months)
Provided individualized tutoring in writing, rhetoric, and critical analysis; developed customized lesson plans and rubrics that improved students' argumentative clarity and stylistic precision.
Conducted literature reviews and synthesized academic sources for faculty projects; assisted in drafting and editing manuscripts and co-developed evaluation rubrics to improve assessment consistency.
Education
Degrees, certifications, and relevant coursework
University of Texas at Austin
Bachelor of Arts, English
Completed a Bachelor of Arts in English with coursework and research experience supporting literature reviews, manuscript editing, and development of evaluation rubrics.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Joel?
You can contact Joel and 90k+ other talented remote workers on Himalayas.
Message JoelFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
