We are a tech transformation specialist looking for an AI Quality Engineer Senior to ensure the quality and accuracy of AI agent systems. The role involves designing evaluation frameworks, measuring accuracy, and establishing baseline evaluations.
Requirements
- Experience evaluating Generative AI, LLMs, and agentic AI systems.
- Strong understanding of AI/ML evaluation metrics and error analysis.
- Hands-on experience with Python and AI evaluation workflows.
- Familiarity with RAG architectures, prompt evaluation, and agent orchestration.
Benefits
- Health and dental insurance
- Meal and food allowance
- Childcare assistance
- Extended paternity leave
- Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass
- Profit Sharing and Results Participation (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club
- Free online platform dedicated to physical, mental, and overall well-being
- Pregnancy and responsible parenting course
- Partnerships with online learning platforms
- Language learning platform
