Himalayas logo
Joel catlettJC
Open to opportunities

Joel catlett

@joelcatlett

Generalist evaluator specializing in AI model testing, rubric design, and research synthesis.

United States
Message

What I'm looking for

I seek a remote role evaluating AI models and designing rubrics, collaborating on benchmarking, and providing clear, research-driven feedback for product and instructional improvements.

I am a generalist evaluator with six years' experience designing rubrics and testing AI models for clarity, coherence, and factual accuracy. I combine research synthesis and instructional design to produce structured, actionable evaluation frameworks.

As a freelance consultant, I craft written content and research summaries for academic, business, and technical audiences while developing and testing prompts to improve AI outputs. I have hands-on experience grading model outputs across platforms such as ChatGPT, Claude, and Gemini.

In prior roles I supported faculty research through literature reviews, manuscript editing, and development of peer-review rubrics, improving assessment accuracy and consistency. I also provided individualized tutoring in writing and critical analysis, designing customized lesson plans and rubrics to strengthen argumentation and stylistic precision.

I seek roles where I can apply rigorous analytical benchmarks to refine AI performance and content quality, collaborate on structured benchmarking projects, and deliver clear, research-grounded feedback that supports product and instructional improvements.

Experience

Work history, roles, and key accomplishments

SE
Current

Freelance Writing & Research Consultant

Self-Employed

Jan 2022 - Present (3 years 10 months)

Produce tailored written content and research summaries and design rubrics and prompts to test and improve AI outputs for clarity, tone, and factual accuracy across academic and technical projects.

PT

Writing Instructor

Private Tutoring

Aug 2020 - Dec 2021 (1 year 4 months)

Provided individualized tutoring in writing, rhetoric, and critical analysis; developed customized lesson plans and rubrics that improved students' argumentative clarity and stylistic precision.

Education

Degrees, certifications, and relevant coursework

University of Texas at Austin logoUA

University of Texas at Austin

Bachelor of Arts, English

Completed a Bachelor of Arts in English with coursework and research experience supporting literature reviews, manuscript editing, and development of evaluation rubrics.

Tech stack

Software and tools used professionally

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Joel catlett - Freelance Writing & Research Consultant - Self-Employed | Himalayas