Twelve Labs is pioneering the development of multimodal foundation models that comprehend videos like humans do. We are seeking a Computational Linguist, AI Evaluation to join our ML Data Team and drive our post-training model evaluation strategy.
Requirements
- 5+ years of experience working in an AI focused data operations organization
- Proven track record designing and executing large scale data or evaluation projects
- Ability to analyze messy and complex data, identify overarching patterns, and distill findings into crisp annotation guidelines or model quality reports
- Proficiency with Python, LLMs, or other popular industry tools for automation
- Excellent communication and project management skills
- Foundational understanding of and interest in LLMs/VLMs and multimodal AI
Benefits
- An open and inclusive culture and work environment
- Full health, dental, and vision benefits
- Flexible PTO and parental leave policy
- Office closed the week of Christmas and New Years
