Software Development Engineer in Test (SDET) - AI Models

At IT Labs, we are looking for a unique talent, an SDET who lives and breathes AI. As an AI SDET, you will play a crucial role in the test engineering activities within a Scrum Team and contribute to the successful execution of testing strategies. You will develop and share your knowledge within an Agile team and assist AI engineers build and test product features based on AI/ML models. You will identify, experiment, and use a variety of testing tools relevant to our business environment and promote testing awareness within Engineering. Additionally, you will support the shifting testing left approach across Engineering and help define and maintain test data and scalable frameworks.

Primary Responsibilities include:

• Reviewing requirement specifications and user stories to provide timely and meaningful feedback.
• Evaluating model and statistical assumptions, methodologies, and outputs and performing other backend / software testing needs (e.g., REST API testing).
• Leading test design sessions that will enhance overall product quality.
• Designing, developing, and executing automation scripts that run within automation frameworks / pipelines using tools such as Java, Python, R, Julia, Rest Assured, JMeter, etc.
• Identifying, documenting, and tracking issues to ensure timely resolution.
• Collaborating with fellow Engineers, spanning AI / Software / Test, and Product Managers across the organization to understand the context and drive advancement of AI test automation and related topics to promote and improve product quality.
• Assisting and supporting peers and Scrum team members to expand their capabilities and improve testing knowledge.

Additional Responsibilities may include:

• Integrating automation scripts into continuous integration processes using tools like Jenkins and GitHub Actions, and advocating for continuous testing practices.

Requirements

• A degree in Mathematics, Statistics, Operations Research, Finance, Computer Science, or a related field, or 5-7 years of equivalent experience with statistical and analytical tools and software.
• Previous experience in testing AI models or services.
• Experience in one or more of the following: Java, Python, R, Scala, Julia.
• Experience with data generation techniques to support model validation.
• The ability to identify flaws in the testing process, toolset, and infrastructure, and to propose and drive necessary improvements.
• The ability to work independently to ensure quality testing throughout the software life cycle by identifying, documenting, and tracking issues.
• Knowledge of machine learning and artificial intelligence techniques.
• Hands-on experience with one or more automated testing tools, such as JMeter, Rest Assured, etc.
• Familiarity with GitHub Actions, DevOps, Gradle, Jenkins, Docker, K8s, and Helm chart

You are:

• Experienced in building backend test automation scripts and frameworks and working in a continuous delivery/continuous testing environment.
• Experienced in working within an Agile/Scrum development process.
• Able to identify testing and quality challenges and create innovative solutions to solve complex problems.
• A person with strong communication skills who enjoys collaborating with co-workers.
• Able to combine automation skills with manual testing (exploratory).
• Capable of thinking independently with curiosity, criticism, and keen attention to detail.
• Well-organized and accustomed to working in an innovative environment.

Benefits

• Long-term 12-month contract
• Choose your contract: Contractor or B2B,
• 10 Days PTO after 4 months of working in IT Labs,
• Referral Bonuses,
• Virtual Knowledge Sharing Sessions, Events and Team Hangouts.

Our values

We are a company that seeks the best for both our employees and clients, reaching beyond expectations in turning dreams into reality. Our way of working is rooted in our core values (Integrity, Excellence, Proactivity, Innovation, and People), with an expectation that our future colleagues will make these their second nature in their everyday work and life. We don’t ask for perfection, but we do appreciate people motivated to better themselves in every conceivable aspect.

About IT Labs

Founded in 2005, IT Labs is an international software tech company, specializing in purpose and process-driven teams for high-performance, innovation, transformation, and efficiency. Our HQ is in Palm Beach Gardens, Florida, and we have teams and offices around the world - the US, the UK, the Netherlands, Argentina, Brazil, Serbia, and North Macedonia. We are constantly growing, and we would love for you to become part of our team!