Nebius hiring Senior Software Engineer — AI Studio (Inference Platform) • Remote (Work from Home) | Himalayas
NebiusNE

Senior Software Engineer — AI Studio (Inference Platform)

Nebius is a cutting-edge AI cloud platform that offers scalable infrastructure for developing and deploying AI solutions.

Nebius

Employee count: 201-500

CZ, DE + 2 more

Why work at Nebius
Nebius is leading a new era in cloud computing to serve the global AI economy. We create the tools and resources our customers need to solve real-world challenges and transform industries, without massive infrastructure costs or the need to build large in-house AI/ML teams. Our employees work at the cutting edge of AI cloud infrastructure alongside some of the most experienced and innovative leaders and engineers in the field.

Where we work
Headquartered in Amsterdam and listed on Nasdaq, Nebius has a global footprint with R&D hubs across Europe, North America, and Israel. The team of over 800 employees includes more than 400 highly skilled engineers with deep expertise across hardware and software engineering, as well as an in-house AI R&D team.

AI Studio is a part of Nebius Cloud, one of the world’s largest GPU clouds, running tens of thousands of GPUs. We are building an inference platform that makes every kind of foundation model — text, vision, audio, and emerging multimodal architectures — fast, reliable, and effortless to deploy at massive scale. To keep pace with growing demand, we’re searching for engineers who want to craft world-class APIs and push the outer limits of latency, routing, and throughput.

In this role you will design and implement the services that power inference for both internal and external customers. You’ll integrate and scale model back-ends, create sophisticated request-routing logic for high-throughput, low-latency workloads, and fortify our observability pipeline so the platform stays rock-solid as we charge toward the next growth leap. The work ranges from performance tuning and memory management to multi-tenant scheduling, with opportunities to hunt microseconds using CUDA, Triton, or other kernel-level profilers whenever the hardware demands it.

We’re looking for developers who are fluent in Python, Go, or Rust; comfortable with asynchronous programming and distributed architectures; and practiced in API design, load balancing, caching, and queuing, all backed by clean, test-driven code and modern CI/CD. Familiarity with popular inference frameworks and back-ends (such as vLLM, sglang, or ComfyUI) and with orchestration stacks like Kubernetes, Ray, or FastAPI will help you hit the ground running. Equally important is a collaborative mindset: you communicate openly, enjoy working across disciplines, and like mentoring teammates as much as optimizing code paths.If shaping the infrastructure that powers tomorrow’s multimodal AI excites you, we’d love to hear from you.

What we offer

  • Competitive salary and comprehensive benefits package.
  • Opportunities for professional growth within Nebius.
  • Hybrid working arrangements.
  • A dynamic and collaborative work environment that values initiative and innovation.

We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Senior

Location requirements

Hiring timezones

Czechia +/- 0 hours, and 3 other timezones

About Nebius

Learn more about Nebius and their company culture.

View company profile

At Nebius, we offer an advanced AI cloud platform designed for those who wish to develop, tune, and deploy their AI models with the most efficient infrastructure available. Our platform utilizes cutting-edge NVIDIA GPU clusters, including the H100 and H200, optimized for maximum performance with InfiniBand. One of the standout features of Nebius is our comprehensive fine-tuning ecosystem that includes on-demand GPUs and tools necessary for robust dataset processing, ensuring that AI teams can efficiently manage their computational resources according to demand.

We recognize the importance of AI inference in deploying real-world applications. Hence, we provide a resilient and cost-effective infrastructure that has been optimized for rapid deployment of Generative AI applications. Our services span the entire lifecycle of AI solutions, from model training to inference, making Nebius not just a GPU cloud but a full-stack AI platform. Additionally, we pride ourselves on supporting our clients with 24/7 expert guidance, offering resources to help architects and engineers harness our AI-optimized data centers to build scalable solutions.

Claim this profileNebius logoNE

Nebius

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

3 remote jobs at Nebius

Explore the variety of open remote roles at Nebius, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Nebius

Remote companies like Nebius

Find your next opportunity by exploring profiles of companies that are similar to Nebius. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan