
Aman Hashmi
@amanhashmi1
LLM output evaluator practicing RLHF who compares model responses and audits for hallucinations, logic, and policy compliance.
What I'm looking for
In my independent practice as an AI Output Evaluator and Prompt Auditor, I compare multi-turn LLM responses side by side using a standardized rubric. I assess logical consistency, hallucinations, and policy compliance.
I analyze hallucinations to distinguish factual distortion and ungrounded claims from acceptable paraphrase, and apply formal logic to identify invalid deductions and fallacies. I write evidence-based justifications for model preferences, grounded in logical soundness, source fidelity, and instruction compliance.
Through independent study in formal logic, cognitive science, and critical theory, I’ve strengthened my approach to evaluating arguments and synthesizing conflicting sources without adding unsupported assumptions. My portfolio includes anonymized A/B evaluations covering source fidelity, fallacy identification, and policy compliance.
Experience
Work history, roles, and key accomplishments
Independent AI Output Evaluator
Specialized Practice
Evaluated dozens of multi-turn LLM responses side by side (A/B) using a standardized rubric for logical consistency, hallucination detection, and policy compliance. Tracked four error categories and performed root-cause analyses on hallucinations.
Analytical Research & Critical Reasoning Studies
Independent Study
Engaged in structured, self-directed study across formal logic, cognitive science, and critical theory, sharpening premise evaluation, counter-argumentation, and conceptual stress-testing. Synthesized conflicting texts from multiple domain sources.
Education
Degrees, certifications, and relevant coursework
BIRT
Bachelor of Technology, Computer Science and Engineering
2023 -
Pursuing a Bachelor of Technology in Computer Science and Engineering, expected to graduate in 2026.
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Skills
Interested in hiring Aman?
You can contact Aman and 600K+ other talented remote workers on Himalayas.
Message AmanGet matched with your dream remote job
Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
