Skip to main content
BG
Looking for a job

Benjamin Geyer

@benjamingeyer

Senior Artificial Intelligence Engineer at MITRE who reduced tool-call format hallucinations from >90% to 0%.

United States
Message

At MITRE, I developed human-in-the-loop, tool-augmented LLM workflows to improve user control, interpretability, and reliability. I implemented constrained-output generation that reduced tool-call format hallucinations from >90% to 0%, and presented the results at internal conferences.

I led a project developing a new version of an internal tool used by 1000+ users, integrating agentic hierarchical RAG workflows with human fact verification and feedback. I presented demos, incorporated stakeholder feedback, and secured future funding.

I also architected an RL training system for cyber agents, including Caldera and CyberLayer, and served as an RL subject matter expert for cyber defense via deception research later presented at Black Hat. At Heron Systems Inc. (A Shield AI Company), I used reinforcement learning to train autonomous fighter pilots for beyond-visual-range combat for the Air Force Research Laboratory.

Experience

Work history, roles, and key accomplishments

MITRE logoMI

Senior Artificial Intelligence Engineer

MITRE

Jan 2023 - Jul 2025 (2 years 6 months)

Developed Human-in-the-Loop tool-augmented LLM workflows to enhance user control, interpretability, and reliability. Implemented constrained-output generation to reduce tool-call format hallucinations from >90% to 0% and presented results at internal conferences.

HI

Applied Research Machine Learning Engineer

Heron Systems Inc.

Sep 2021 - Sep 2022 (1 year)

Utilized Reinforcement Learning including PPO and A3C to train autonomous fighter pilots for Beyond-Visual-Range combat for the Air Force Research Laboratory. Designed and refined reward functions to reduce reward exploitation and agent bias, incorporating SME domain knowledge for validation.

NR

Full Stack Software Engineer

Name Withheld - Provided Upon Request

Jun 2019 - Nov 2020 (1 year 5 months)

Designed and developed web and desktop applications utilizing Angular, Django REST Framework, and PostgreSQL. Mentored interns on development best practices and Agile workflows.

AI

Machine Learning Engineering Intern

Applied Security Inc.

Jun 2018 - May 2019 (11 months)

Researched new algorithms for Document Authorship Attribution.

Education

Degrees, certifications, and relevant coursework

George Mason University logoGU

George Mason University

Master of Science, Machine Learning

2019 - 2021

Master of Science in Machine Learning from George Mason University, completed in 2021.

George Mason University logoGU

George Mason University

Bachelor of Science, Computer Science

2016 - 2019

Bachelor of Science in Computer Science from George Mason University, completed in 2019.

Northern Virginia Community College logoNC

Northern Virginia Community College

Dual Enrollment, Computer Science

2015 - 2016

Dual enrollment for CS courses and prerequisites at Northern Virginia Community College.

Thomas Jefferson High School for Science and Technology logoTT

Thomas Jefferson High School for Science and Technology

High School Diploma, High School

2012 - 2015

High school education at Thomas Jefferson High School for Science and Technology.

Interested in hiring Benjamin?

You can contact Benjamin and 90k+ other talented remote workers on Himalayas.

Message Benjamin

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan