Arize AIAA

Infrastructure Software Engineer, On Prem Deployments

Arize AI is an AI observability and LLM evaluation platform designed to help AI engineers and developers surface model issues, resolve their root cause, and improve model performance.

Arize AI

Employee count: 51-200

Salary: 160k-210k USD

United States only

The Opportunity

AI is rapidly transforming the world. Whether it’s developing the next generation of human-level intelligence, enhancing voice assistants, or enabling researchers to analyze genetic markers at scale, AI is increasingly integrated into various aspects of our daily lives.

Arize is the leading AI observability and Evaluation platform to help AI teams discover issues, diagnose problems, and improve the results of their AI Applications. We are here to build world class software that helps make AI applications work better.

As our On-Premises Infrastructure Engineer reporting to the Head of AI Infrastructure, you'll be instrumental in designing and implementing deployment architectures and software that bring Arize's powerful capabilities directly into our customers' environments. This is a unique opportunity to bridge the gap between cutting-edge AI observability and enterprise infrastructure requirements.

The Role

We're seeking an exceptional Infrastructure Engineer who can navigate complex enterprise environments and has a proven track record of building scalable on-premises solutions. You'll be a key player in our engineering organization, working directly with the CTO and customers to architect and implement solutions that enable seamless deployment of our platform across diverse customer environments.

We are a fully remote company with offices in Bay Area, NYC

What You’ll Work On

  • Design and implement robust deployment architectures that enable Arize to run efficiently in diverse customer environments, from air-gapped systems to hybrid cloud setups
  • Collaborate with customers to understand their infrastructure requirements and create tailored deployment solutions that meet their security, compliance, and performance needs
  • Develop and maintain automation tools and frameworks that streamline the deployment, upgrade, and maintenance processes for on-premises installations
  • Partner with the product team to ensure new features are compatible with on-premises deployments and create efficient release mechanisms
  • Create comprehensive monitoring and observability solutions that enable customers to maintain and troubleshoot their Arize installations effectively

What Will Set You Apart

  • 5+ years of experience in infrastructure engineering, with significant exposure to enterprise on-premises deployments
  • Deep expertise in container orchestration platforms (especially Kubernetes) and infrastructure-as-code tools like Terraform
  • Strong background in enterprise networking, security requirements, and compliance considerations
  • Experience working with multiple cloud providers (AWS, GCP, Azure) and understanding how to adapt cloud-native architectures for on-premises environments
  • Track record of building and maintaining automation tools that improve deployment reliability and reduce operational overhead
  • Excellent communication skills and ability to work directly with customers to understand and address their infrastructure needs
  • Experience with Python, Golang, and JavaScript is highly desirable

The estimated annual salary and variable compensation for this role is between $160,000 - $210,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work and work for the people. Our founders came together through a common frustration: investments in AI are growing rapidly across businesses and organizations of all types, yet it is incredibly difficult to understand why a machine learning model behaves the way it does after it is deployed into the real world.

Learn more about Arize in an interview with our founders: https://www.forbes.com/sites/frederickdaso/2020/09/01/arize-ai-helps-us-understand-how-ai-works/#322488d7753c

Diversity Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Mid-level

Salary

Salary: 160k-210k USD

Location requirements

Hiring timezones

United States +/- 0 hours

About Arize AI

Learn more about Arize AI and their company culture.

View company profile

Arize AI is dedicated to helping customers navigate the complexities of artificial intelligence and machine learning model performance. Many organizations invest heavily in developing AI models, only to find that their real-world performance is difficult to track, understand, and improve. Our customers face challenges such as model drift, where a model's predictive accuracy degrades over time due to changes in data; data quality issues that can silently corrupt model inputs and outputs; and the 'black box' nature of many AI systems, making it hard to diagnose why a model is making certain predictions or behaving unexpectedly. These challenges can lead to poor business outcomes, loss of customer trust, and inefficient use of resources.

To address these critical pain points, Arize AI provides a comprehensive AI observability and LLM evaluation platform. We empower AI engineers, data scientists, and ML practitioners to surface model issues quickly, trace them to their root cause, and ultimately, improve model performance and reliability. Our platform offers real-time monitoring, automated drift detection, explainability tools, and robust analytics to provide a clear view into how models are behaving in production. By offering a centralized inference store and connecting offline training and validation data with online production data, we enable teams to proactively identify and resolve issues before they significantly impact business operations. Whether our customers are working with traditional machine learning models, large language models (LLMs), or complex AI agents, Arize AI offers the tools and insights needed to ensure their AI initiatives are successful, transparent, and deliver tangible value. We are committed to fostering a future where AI works effectively and responsibly for everyone.

Claim this profileArize AI logoAA

Arize AI

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

12 remote jobs at Arize AI

Explore the variety of open remote roles at Arize AI, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Arize AI

Remote companies like Arize AI

Find your next opportunity by exploring profiles of companies that are similar to Arize AI. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Arize AI hiring Infrastructure Software Engineer, On Prem Deployments • Remote (Work from Home) | Himalayas