Freelance AI Evaluation Engineer (Python/Full-Stack)

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. You’ll create challenging coding test cases that push AI coding systems to their limits and review and refine realistic coding tasks based on provided production codebases with realistic scope, requirements and information sources.

Requirements

• Degree in Computer Science, Software Engineering or related fields
• 5+ years in software development, primarily Python (pytest, async/await, subprocess, file operations)
• Background in Full-Stack development, with an equal focus on building React-based interfaces and robust Back-end systems
• Experience writing tests (functional, integration – not just running them)
• Docker containers (running evaluations locally in containers)
• CI/CD understanding (GitHub Actions as a user: triggers, labels, reading results)
• English proficiency - B2

Benefits

• Flexible project schedule
• Opportunity to work with leading tech companies
• Variety of projects to choose from