We are looking for a Senior Software Engineer in Test to create challenging coding test cases that push AI coding systems to their limits. You will review and refine realistic coding tasks, write comprehensive functional tests, and analyze AI failures. This is a part-time opportunity with estimated tasks taking 20 hours to complete, and contributors can earn up to $50 per hour equivalent.
Requirements
- Degree in Computer Science, Software Engineering or related fields
- 5+ years in software development, primarily Python
- Background in Full-Stack development with an equal focus on building React-based interfaces and robust Back-end systems
- Experience writing tests (functional, integration)
- Docker containers (running evaluations locally in containers)
- CI/CD understanding (GitHub Actions as a user: triggers, labels, reading results)
- English proficiency - B2
Benefits
- Competitive hourly rate of up to $50 per hour equivalent
- Part-time opportunity with flexible work schedule
- Opportunity to work on challenging projects and improve AI systems
