Senior Software Engineer - AI Training Review Layer (Python)

Accepted Locations and Languages

For the complete list of accepted locations, click here. This work is 100% remote.

Project Availability

We are currently accepting a limited number of new candidates, and our client anticipates a weekly need for 20-25 top performers. Candidates who perform well but are not immediately assigned to projects will be placed on a bench as we ramp up to a higher volume of work.

Loom Video

Our Founder/CEO, Gabe Greenberg, created a more in-depth Loom video that we highly recommend you watch! Check it out here:https://www.loom.com/share/5a8972c7fbbf46aaa3f389b2b6391c40

Overview

You’ll join an expert annotation team to create training data for the world's most advanced AI models. No previous AI experience is necessary. You'll get your foot in the door with one of the most prominent players in the AI/LLM space today. We seek software engineers with 4+ years of experience to train large AI language models, helping cutting-edge generative AI models write better code. Projects typically include discrete, highly variable problems that involve engaging with these models as they learn to code. We currently have 200+ roles open!

What Will I Be Doing?

• Evaluating the quality of AI-generated code, including human-readable summaries of your rationale

• Solve coding problems, writing functional and efficient code

• Writing robust test cases to confirm code works efficiently and effectively

• We asked the technical project manager to go into even more detail and this is how he answered: It is solving coding challenges, creating instructions to help others, reviewing the code before it goes into the model, and there's a ton of variety in the projects. We have everything from "Which piece of Python code is better?" to "Make a full mobile application using this chatbot, and improve the chatbot's responses afterward to make it faster."

Pay Rates

• Pay rates vary based on location and seniority; see this list.

• Expectations are 15+ hours per week; however, there is no upper limit. We have engineers working 20-40 hours per week and some working 40+ hours per week. You can work as much as you want to. You'll get paid weekly per hour of work done on the platform.

Contract Length

• Long term, there is no end date. They expect to have work for the next 2 years.

• You can end the contract at any time. We hope you will commit to 12 months of work, but if you start and it's not a fit for you, we totally understand.

Flexible Schedules

• Developers can set their own hours—ideal candidates will be interested in spending 40 hours a week. They will be with teams, so strong performers will adapt to the urgency of projects and stay engaged, but they will also be incredibly flexible on working hours.

• You can take a 3-hour lunch, no problem. Instead of tracking your hours, you are paid according to time spent on the platform, calculated in the coding exercises.

Interview Process

1. Apply using this Ashby form.

2. If you seem like a good fit, we'll send an async RLHF code review that will take 35 minutes and must be finished within 72 hours of us sending it.

3. You'll receive credentials to the RLHF platform. We'll then set up a group call to answer any further questions about onboarding with the company.

4. You'll perform a simulated production-level task (RLHF task) on the platform. This will be your final interview, which will ultimately determine your employment and leveling. Successful completion of this process provides you with an opportunity to work on projects as they become available.

Tech Stack Priorities

• The current priority for this team is software engineers who are well-versed in Python.

Required Qualifications:

• Master’s or PhD in Computer Science, OR Bachelor’s in Computer Science / Engineering / STEM with 4+ years of specialized experience

• Complete fluency in the English language.

• Ability to articulate complex scientific concepts clearly and engagingly.

• Excellent attention to detail and ability to maintain consistency in writing.

• Solid understanding of grammar, punctuation, and style guidelines.

• Proficiency with Python.

Nice To Haves:

• Recognized accomplishments or contributions to the coding community or in projects.

• Proven analytical skills with an ability to approach problems creatively.

• Adept communication skills, especially when understanding and discussing project requirements.

• A commitment to continuous learning and staying updated with the latest coding advancements and best practices.

• Enthusiasm for teaching AI models and experience with technical writing!