Skip to main content
ismael juniorIJ
Looking for a job

ismael junior

@ismaeljunior

AI benchmark quality reviewer at Perplexity AI, auditing agent traces and evaluation criteria for evidence-based findings.

Brazil
Message

At Perplexity AI, I validate benchmark instructions, source materials, reference solutions, and evaluation criteria. I inspect agent traces and audit grading logic, then document evidence-based findings and actionable improvements.

On Project Cursa (V2), I annotate robot-manipulation videos using synchronized camera views. I segment timelines and describe actions at atomic-movement, subtask, and task levels, recording observed outcomes accurately, including failed grasps and dropped objects.

At Alignerr, I transcribe and review Brazilian Portuguese audio, checking word-level accuracy, timestamps, speaker identification, and audio-text alignment. My other work includes evaluating AI responses, reviewing benchmark evidence, and contributing to open-source projects through GitHub.

Experience

Work history, roles, and key accomplishments

PD
Current

AI Response Preference Evaluator

Project Draco

Oct 2026 - Present (1 month)

Reviewed multi-turn user conversations and attached images, comparing two candidate AI responses and selecting the one that best fulfills the user's needs. Provided concise, evidence-based explanations for preferences.

AP
Current

Portuguese Audio Transcription & Quality Reviewer

Alignerr (Ermis Project)

Jun 2026 - Present (5 months)

Transcribed and reviewed Brazilian Portuguese audio, correcting errors and validating word-level accuracy, timestamps, speaker identification, and audio-text alignment. Applied detailed transcription and labeling standards consistently.

IP
Current

Open Source Contributor

Independent / Project-Based

Jan 2022 - Present (4 years 10 months)

Used repositories, branches, commits, pull requests, and README documentation for traceable project updates.

OP

Data Labeler / Data Annotator & Human Transcriber

OpsArmy

Annotated data and reviewed transcriptions for linguistic accuracy, completeness, and consistency, flagging ambiguous inputs.

Education

Degrees, certifications, and relevant coursework

BA

Bachelor of Business Administration

Bachelor, Business Administration

Completed a Bachelor of Business Administration in 2025.

BL

Bachelor of Laws

Bachelor, Law

Completed a Bachelor of Laws in 2021.

BL

Bachelor of Education in Portuguese Language

Bachelor, Portuguese Language

Completed a Bachelor of Education in Portuguese Language in 2019.

FA

FAETEC

Technician, Naval Structures

Completed a Naval Structures Technician program at FAETEC in 2015.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan