Skip to main content
Aman HashmiAH
Looking for a job

Aman Hashmi

@amanhashmi1

LLM output evaluator practicing RLHF who compares model responses and audits for hallucinations, logic, and policy compliance.

India
Message

What I'm looking for

I'm seeking RLHF and model-evaluation roles.

In my independent practice as an AI Output Evaluator and Prompt Auditor, I compare multi-turn LLM responses side by side using a standardized rubric. I assess logical consistency, hallucinations, and policy compliance.

I analyze hallucinations to distinguish factual distortion and ungrounded claims from acceptable paraphrase, and apply formal logic to identify invalid deductions and fallacies. I write evidence-based justifications for model preferences, grounded in logical soundness, source fidelity, and instruction compliance.

Through independent study in formal logic, cognitive science, and critical theory, I’ve strengthened my approach to evaluating arguments and synthesizing conflicting sources without adding unsupported assumptions. My portfolio includes anonymized A/B evaluations covering source fidelity, fallacy identification, and policy compliance.

Experience

Work history, roles, and key accomplishments

SP

Independent AI Output Evaluator

Specialized Practice

Evaluated dozens of multi-turn LLM responses side by side (A/B) using a standardized rubric for logical consistency, hallucination detection, and policy compliance. Tracked four error categories and performed root-cause analyses on hallucinations.

RLHF
Side By Side Evaluations
Rubric Based ScoringHallucination Detection
Fallacy Detection
Policy Compliance
Logic
Error Classification
IS

Analytical Research & Critical Reasoning Studies

Independent Study

Engaged in structured, self-directed study across formal logic, cognitive science, and critical theory, sharpening premise evaluation, counter-argumentation, and conceptual stress-testing. Synthesized conflicting texts from multiple domain sources.

Education

Degrees, certifications, and relevant coursework

BI

BIRT

Bachelor of Technology, Computer Science and Engineering

2023 -

Pursuing a Bachelor of Technology in Computer Science and Engineering, expected to graduate in 2026.

Tech stack

Software and tools used professionally

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

70k+ INR

Job categories

AI Output Evaluator
AI Engineer

Skills

RLHFLLM EvaluationPreference RankingA B TestingRubric Based Scoring
Error Classification
LLM Output Assessment
Hallucination Detection
Instruction Adherence
Constraint Verification
Compliance Auditing
Source Text Fidelity
Semantic Consistency
Fallacy Detection
Logic

Interested in hiring Aman?

You can contact Aman and 600K+ other talented remote workers on Himalayas.

Message Aman

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan