Himalayas logo
NebiusNE

Infrastructure Software Engineer

Nebius is a cutting-edge AI cloud platform that offers scalable infrastructure for developing and deploying AI solutions.

Nebius

Employee count: 201-500

Salary: 150k-210k USD

United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

Why work at NebiusNebius is leading a new era in cloud computing to serve the global AI economy. We create the tools and resources our customers need to solve real-world challenges and transform industries, without massive infrastructure costs or the need to build large in-house AI/ML teams. Our employees work at the cutting edge of AI cloud infrastructure alongside some of the most experienced and innovative leaders and engineers in the field.

Where we workHeadquartered in Amsterdam and listed on Nasdaq, Nebius has a global footprint with R&D hubs across Europe, North America, and Israel. The team of over 800 employees includes more than 400 highly skilled engineers with deep expertise across hardware and software engineering, as well as an in-house AI R&D team.

The role

Nebius operates large-scale, mission-critical bare-metal infrastructure. As a Software Engineer (Python), you will design and build systems that provision, configure, test, and manage physical hardware at scale. Your work will sit close to the metal—interfacing directly with servers, networks, and management controllers—while supporting highly automated, reliable infrastructure operations.

You will collaborate closely with hardware, networking, and data center operations teams to ensure our platforms are robust, scalable, and production ready.

Your responsibilities will include:

  • Design and develop backend services and automation in Python
  • Build and maintain systems for hardware provisioning, testing, and lifecycle management
  • Develop software that runs directly on bare-metal environments
  • Integrate with Linux systems, using Bash and low-level tooling where needed
  • Implement and maintain CI/CD pipelines for infrastructure-focused software
  • Work with networking services including IPv4/IPv6, DHCP, DNS, network boot, and server boot workflows
  • Interface with BMC controllers and management protocols (IPMI-style protocols, HTTP-based standards)
  • Enable reliable hardware interaction and automation across large fleets
  • Support ARM64 / ARM64EC architectures
  • Design and integrate NoSQL data stores for system state and orchestration data
  • Write clear documentation and contribute to operational excellence

What we expect you to have:

  • Strong professional experience as a software engineer, with a focus on Python
  • Solid experience with Linux systems and shell scripting
  • Hands-on experience working with bare-metal servers or low-level infrastructure Strong understanding of networking fundamentals (IPv4/IPv6, DHCP, DNS, PXE / network boot)
  • Experience interacting with hardware management interfaces (BMC, IPMI-like protocols, HTTP APIs)
  • Familiarity with CI/CD systems and production deployment workflows
  • Experience designing or working with NoSQL databases
  • Ability to debug complex issues spanning software, hardware, and networks
  • Strong ownership mindset and clear communication skills in a distributed team

It will be an added bonus if you have:

  • Experience operating or building systems for large-scale infrastructure
  • Familiarity with ARM-based platforms in production environments
  • Background in hardware testing, validation, or factory provisioning
  • Experience with infrastructure automation or internal platform tooling
  • Contributions to open-source or internal systems software projects

Working conditions:

  • Fully remote position (United States)
  • Collaboration with globally distributed engineering and operations teams

Key employee benefits:

  • Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families
  • 401(k) plan: up to 4% company match with immediate vesting
  • Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers
  • Remote work reimbursement: up to $85/month for mobile and internet
  • Disability & life insurance: company-paid short-term, long-term, and life insurance coverage

Compensation

  • We offer competitive salaries, ranging from $150k- $210k base equity + quarterly performance bonuses.

Join Nebius today and help build the software that powers the next generation of

AI infrastructure.

What we offer

  • Competitive salary and comprehensive benefits package.
  • Opportunities for professional growth within Nebius.
  • Flexible working arrangements.
  • A dynamic and collaborative work environment that values initiative and innovation.

We’re growing and expanding our products every day. If you’re up to the challenge and are excited about AI and ML as much as we are, join us!

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Mid-level
Senior

Salary

Salary: 150k-210k USD

Location requirements

Hiring timezones

United States +/- 0 hours

About Nebius

Learn more about Nebius and their company culture.

View company profile

At Nebius, we offer an advanced AI cloud platform designed for those who wish to develop, tune, and deploy their AI models with the most efficient infrastructure available. Our platform utilizes cutting-edge NVIDIA GPU clusters, including the H100 and H200, optimized for maximum performance with InfiniBand. One of the standout features of Nebius is our comprehensive fine-tuning ecosystem that includes on-demand GPUs and tools necessary for robust dataset processing, ensuring that AI teams can efficiently manage their computational resources according to demand.

We recognize the importance of AI inference in deploying real-world applications. Hence, we provide a resilient and cost-effective infrastructure that has been optimized for rapid deployment of Generative AI applications. Our services span the entire lifecycle of AI solutions, from model training to inference, making Nebius not just a GPU cloud but a full-stack AI platform. Additionally, we pride ourselves on supporting our clients with 24/7 expert guidance, offering resources to help architects and engineers harness our AI-optimized data centers to build scalable solutions.

Claim this profileNebius logoNE

Nebius

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

64 remote jobs at Nebius

Explore the variety of open remote roles at Nebius, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Nebius

Remote companies like Nebius

Find your next opportunity by exploring profiles of companies that are similar to Nebius. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan