Senior Engineer in Test (Experience and Apps)

Job Description:

DataRobot delivers AI that maximizes impact and minimizes business risk. Our platform and applications integrate into core business processes so teams can develop, deliver, and govern AI at scale. DataRobot empowers practitioners to deliver predictive and generative AI, and enables leaders to secure their AI assets. Organizations worldwide rely on DataRobot for AI that makes sense for their business — today and in the future.

As a Senior Engineer in Test, you will be responsible for designing, building, and maintaining automated test frameworks and infrastructure to ensure the quality and performance of our applications and infrastructure. You will play a critical role in defining and implementing test strategies, managing CI/CD pipelines, and collaborating with cross-functional teams to drive the development of high-quality software. With a focus on automation, scalability, and continuous improvement, you will work on both application-level and infrastructure testing, identifying edge cases and potential risks, and ensuring that quality is embedded throughout the software development lifecycle.

Key Responsibilities:

• Automated Test Development:Develop and maintain automated test scripts using Python, Go, and Javascript/Typescript to ensure high-quality software and applications.

• CI/CD Pipeline Management:Design, implement, and maintain CI/CD pipelines, ensuring smooth integration and continuous deployment of code (experience with GitLab CI, Github Actions, Harness.io, or similar is a plus).

• Test Strategy:Work with product and development teams to define testing strategies, scope, and priorities for features, ensuring thorough test coverage across all stages of development.

• Test Automation at Scale: Develop large-scale, maintainable test automation systems and frameworks, ensuring they can scale with growing applications and infrastructure needs. Experience with Locust.io, k6, or similar is a plus.

• Quality Assurance:Identify edge cases, potential risks, and weaknesses in both applications and infrastructure, advocating for the necessary changes to prevent issues.

• Collaboration:Work closely with the teams to ensure seamless integration of tests and quick identification of issues within the development cycle.

• Continuous Improvement:Suggest and implement improvements to testing processes, automated frameworks, and CI/CD pipelines to increase efficiency and reduce the overall development cycle time.

Knowledge, Skills and Abilities:

• 4+ years of experience in Software Engineering

• Proven experience developing software using Python (or similar programming languages).

• Strong experience designing and building test automation frameworks from scratch.

• Hands-on experience working with CI/CD pipeline tools (GitHub Actions, GitLab, CircleCI, etc.) and test automation tools.

• Solid understanding of testing types and methodologies, including unit testing, integration testing, contract, end-to-end, acceptance, and performance tests

• Experience working with large-scale test automation, including distributed systems like Kubernetes, and multiple cloud environments.

• Passionate about testing, with a strong focus on quality and continuous improvement.

• Ability to break down complex software and identify edge cases and potential issues early in the development lifecycle.

Nice to have:

• Experience with testing frameworks such as PyTest, Cypress, Playwright, Selenium, or similar.

• Familiarity with FastAPI/Aiohttp for building asynchronous web servers or clients.

• Experience with React development for front-end testing (preferred, but not required).

• Proficiency in Bash scripting for automating tasks and workflows.

• Hands-on experience with Docker/Kubernetes for containerization and orchestration (CKAD certification preferred).

• Experience working with AWS (or other cloud platforms like GCP, Azure) for cloud infrastructure and services.

• Familiarity with Agile methodologies and collaborative team workflows.

The talent and dedication of our employees are at the core of DataRobot’s journey to be an iconic company. We strive to attract and retain the best talent by providing competitive pay and benefits with our employees’ well-being at the core. Here’s what your benefits package may include depending on your location and local legal requirements: Medical, Dental & Vision Insurance, Flexible Time Off Program, Paid Holidays, Paid Parental Leave, Global Employee Assistance Program (EAP) and more!

DataRobot Operating Principles:

• Wow Our Customers
• Set High Standards
• Be Better Than Yesterday
• Be Rigorous
• Assume Positive Intent
• Have the Tough Conversations
• Be Better Together
• Debate, Decide, Commit
• Deliver Results
• Overcommunicate

Research shows that many women only apply to jobs when they meet 100% of the qualifications while many men apply to jobs when they meet 60%. At DataRobot we encourage ALL candidates, especially women, people of color, LGBTQ+ identifying people, differently abled, and other people from marginalized groups to apply to our jobs, even if you do not check every box. We’d love to have a conversation with you and see if you might be a great fit.

DataRobot is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. DataRobot is committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. Please see the United States Department of Labor’s EEO poster and EEO poster supplement for additional information.

All applicant data submitted is handled in accordance with our Applicant Privacy Policy.