HimalayasHimalayas logo
NebiusNE

Infrastructure Software Engineer

Nebius is a cutting-edge AI cloud platform that offers scalable infrastructure for developing and deploying AI solutions.

Nebius

Employee count: 201-500

Salary: 150k-210k USD

United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

About Nebius:

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

The role

Nebius operates large-scale, mission-critical bare-metal infrastructure. As a Software Engineer (Python), you will design and build systems that provision, configure, test, and manage physical hardware at scale. Your work will sit close to the metal—interfacing directly with servers, networks, and management controllers—while supporting highly automated, reliable infrastructure operations.

You will collaborate closely with hardware, networking, and data center operations teams to ensure our platforms are robust, scalable, and production ready.

Your responsibilities will include:

  • Design and develop backend services and automation in Python
  • Build and maintain systems for hardware provisioning, testing, and lifecycle management
  • Develop software that runs directly on bare-metal environments
  • Integrate with Linux systems, using Bash and low-level tooling where needed
  • Implement and maintain CI/CD pipelines for infrastructure-focused software
  • Work with networking services including IPv4/IPv6, DHCP, DNS, network boot, and server boot workflows
  • Interface with BMC controllers and management protocols (IPMI-style protocols, HTTP-based standards)
  • Enable reliable hardware interaction and automation across large fleets
  • Support ARM64 / ARM64EC architectures
  • Design and integrate NoSQL data stores for system state and orchestration data
  • Write clear documentation and contribute to operational excellence

What we expect you to have:

  • Strong professional experience as a software engineer, with a focus on Python
  • Solid experience with Linux systems and shell scripting
  • Hands-on experience working with bare-metal servers or low-level infrastructure Strong understanding of networking fundamentals (IPv4/IPv6, DHCP, DNS, PXE / network boot)
  • Experience interacting with hardware management interfaces (BMC, IPMI-like protocols, HTTP APIs)
  • Familiarity with CI/CD systems and production deployment workflows
  • Experience designing or working with NoSQL databases
  • Ability to debug complex issues spanning software, hardware, and networks
  • Strong ownership mindset and clear communication skills in a distributed team

It will be an added bonus if you have:

  • Experience operating or building systems for large-scale infrastructure
  • Familiarity with ARM-based platforms in production environments
  • Background in hardware testing, validation, or factory provisioning
  • Experience with infrastructure automation or internal platform tooling
  • Contributions to open-source or internal systems software projects

Working conditions:

  • Fully remote position (United States)
  • Collaboration with globally distributed engineering and operations teams

Key employee benefits:

  • Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families
  • 401(k) plan: up to 4% company match with immediate vesting
  • Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers
  • Remote work reimbursement: up to $85/month for mobile and internet
  • Disability & life insurance: company-paid short-term, long-term, and life insurance coverage

Compensation

  • We offer competitive salaries, ranging from $150k- $210k base equity + quarterly performance bonuses.

Join Nebius today and help build the software that powers the next generation of

AI infrastructure.

Benefits & Perks:

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and work-life balance
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

What's it like to work at Nebius:

Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI

Equal Opportunity Statement:

Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.

Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.

If you need accommodations during the application process, please let us know.

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Salary

Salary: 150k-210k USD

Location requirements

Hiring timezones

United States +/- 0 hours

About Nebius

Learn more about Nebius and their company culture.

View company profile

At Nebius, we offer an advanced AI cloud platform designed for those who wish to develop, tune, and deploy their AI models with the most efficient infrastructure available. Our platform utilizes cutting-edge NVIDIA GPU clusters, including the H100 and H200, optimized for maximum performance with InfiniBand. One of the standout features of Nebius is our comprehensive fine-tuning ecosystem that includes on-demand GPUs and tools necessary for robust dataset processing, ensuring that AI teams can efficiently manage their computational resources according to demand.

We recognize the importance of AI inference in deploying real-world applications. Hence, we provide a resilient and cost-effective infrastructure that has been optimized for rapid deployment of Generative AI applications. Our services span the entire lifecycle of AI solutions, from model training to inference, making Nebius not just a GPU cloud but a full-stack AI platform. Additionally, we pride ourselves on supporting our clients with 24/7 expert guidance, offering resources to help architects and engineers harness our AI-optimized data centers to build scalable solutions.

Claim this profileNebius logoNE

Nebius

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

121 remote jobs at Nebius

Explore the variety of open remote roles at Nebius, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Nebius

Remote companies like Nebius

Find your next opportunity by exploring profiles of companies that are similar to Nebius. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan