We are seeking a Civil Engineering Consultant to join our team as an Engineering AI Evaluator, responsible for evaluating large language model-generated responses for technical accuracy and applied reasoning. The ideal candidate will have a PhD in Engineering and expertise in Mechanical & Physical Systems Engineering, Electrical, Electronic & Computer Engineering, Chemical, Materials & Process Engineering, or Civil, Environmental & Infrastructure Engineering.
Requirements
- Write and refine prompts to guide model behavior in engineering scenarios.
- Evaluate LLM-generated responses for technical accuracy and applied reasoning.
- Conduct fact-checking and verify technical claims using authoritative sources.
- Annotate model responses, identifying strengths and areas for improvement.
- Assess clarity and appropriateness of explanations for different audiences.
- Ensure model responses align with expected conversational behavior and guidelines.
