OctoML

OctoAI delivers production-grade GenAI solutions running on the most efficient compute, empowering builders to launch the next generation of AI applications.

We believe in the power of AI to improve lives.

To get there, AI must become more sustainable and accessible. Our goal is to empower creators to harness the transformative power of ML to build intelligent applications.

OctoML makes AI more sustainable through efficient model execution and automation to scale services and reduce engineering burden. We make AI more accessible by enabling models to run on a broad set of devices and easier to deploy without specialized skills.

Our Story

OctoML was spun out of the University of Washington by the creators of Apache TVM, an open source stack for ML portability and performance. TVM enables ML models to run efficiently on any hardware backend, and has quickly become a key part of the architecture of popular consumer devices like Amazon Alexa.

Recognizing the potential for TVM and technologies like it to transform the full scope of the ML lifecycle, OctoML was born.

What's in a Name?

Thinking about the type of company we wanted to build, we took inspiration from the playful, clever, curious octopus. These unconventional thinkers have a unique, distributed intelligence that spans their entire body.

They are adaptive enough to camouflage at a moment’s notice, and creative enough to complete puzzles, build gardens, and use tools. Plus, like any good engineer, they love to take things apart.

Our operating principles

• Empower users: We believe in knowing our “why” — the compelling higher purpose that inspires us and acts as the source of all we do. At OctoML, our users are our “why.”

• Execute with agility and focus: To build something brand new, we believe in dreaming big and following through on bold ideas. We listen to our users and to each other, adapting to new ideas and ways to work together that help us reach our goal.

• Build a great company together: Through kind collaboration we will foster a welcoming and supportive culture, communicate openly and respectfully, and lead with empathy.