Himalayas logo
Arize AIAA

AI Engineer - Instrumentation

Arize AI is an AI observability and LLM evaluation platform designed to help AI engineers and developers surface model issues, resolve their root cause, and improve model performance.

Arize AI

Employee count: 51-200

Salary: 125k-225k USD

United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors,with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Join Arize AI's Engineering team working on OpenInference – the industry-leading open-source standard for AI observability, LLM and agent instrumentation. You'll be at the forefront of defining how organizations instrument, trace, and observe their AI applications across the entire ecosystem, shaping the future of AI development worldwide. This role puts you at the epicenter of the AI landscape, working directly on the OpenInference repository that powers AI observability for thousands of developers worldwide. You'll synthesize requirements from both the vibrant open-source community and real-world enterprise deployments, translating these diverse needs into practical instrumentation capabilities that drive the future of AI innovation. This is NOT a role for everyone – it demands exceptional technical versatility, deep community engagement, and end-to-end ownership from conception to delivery.

What You’ll Do

  • Build new LLM and instrumentation libraries for emerging LLM providers and agent frameworks
  • Maintain and enhance existing instrumentation across Python and TypeScript ecosystems, and others (OpenAI, Anthropic, LlamaIndex, CrewAI and many more)
  • Drive improvements to semantic conventions and OpenTelemetry standards that define AI observability
  • Collaborate with the global developer community through GitHub, Slack, and conferences, as well as Arize PMs and solution architects
  • Take complex problems from ideation to completion with full ownership and accountability

What We’re Looking For

  • 3-5+ years of software development experience shipping production code
  • Expert-level proficiency in both Python and TypeScript
  • Community-oriented mindset with genuine passion for collaborative open-source development
  • Deep interest in AI/LLM ecosystem with desire to stay current on emerging technologies
  • Strong analytical skills to distill requirements from diverse sources and stakeholders

Bonus Points, But Not Required

  • Experience building SDK clients, instrumentation libraries, or platform APIs
  • Hands-on experience with AI/ML observability or evaluation systems

What Makes This Role Unique?

You'll have direct impact on the AI ecosystem by building instrumentation that powers the next generation of AI applications across thousands of companies. Working at the intersection of open-source community building and enterprise-scale AI deployments, you'll help define industry standards while staying at the forefront of LLM technologies.

The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Mid-level
Senior

Salary

Salary: 125k-225k USD

Location requirements

Hiring timezones

United States +/- 0 hours

About Arize AI

Learn more about Arize AI and their company culture.

View company profile

Arize AI is dedicated to helping customers navigate the complexities of artificial intelligence and machine learning model performance. Many organizations invest heavily in developing AI models, only to find that their real-world performance is difficult to track, understand, and improve. Our customers face challenges such as model drift, where a model's predictive accuracy degrades over time due to changes in data; data quality issues that can silently corrupt model inputs and outputs; and the 'black box' nature of many AI systems, making it hard to diagnose why a model is making certain predictions or behaving unexpectedly. These challenges can lead to poor business outcomes, loss of customer trust, and inefficient use of resources.

To address these critical pain points, Arize AI provides a comprehensive AI observability and LLM evaluation platform. We empower AI engineers, data scientists, and ML practitioners to surface model issues quickly, trace them to their root cause, and ultimately, improve model performance and reliability. Our platform offers real-time monitoring, automated drift detection, explainability tools, and robust analytics to provide a clear view into how models are behaving in production. By offering a centralized inference store and connecting offline training and validation data with online production data, we enable teams to proactively identify and resolve issues before they significantly impact business operations. Whether our customers are working with traditional machine learning models, large language models (LLMs), or complex AI agents, Arize AI offers the tools and insights needed to ensure their AI initiatives are successful, transparent, and deliver tangible value. We are committed to fostering a future where AI works effectively and responsibly for everyone.

Claim this profileArize AI logoAA

Arize AI

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

11 remote jobs at Arize AI

Explore the variety of open remote roles at Arize AI, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Arize AI

Remote companies like Arize AI

Find your next opportunity by exploring profiles of companies that are similar to Arize AI. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Arize AI hiring AI Engineer - Instrumentation • Remote (Work from Home) | Himalayas