d-Matrix hiring Inference Runtime Systems - Software Engineer, Staff • Remote (Work from Home) | Himalayas
d-MatrixD-

Inference Runtime Systems - Software Engineer, Staff

d-Matrix is at the forefront of AI inference technology, providing innovative solutions that enhance the efficiency and scalability of AI applications.

d-Matrix

Employee count: 51-200

Salary: 142k-230k USD

United States only

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together, we can help shape the endless possibilities of AI.

Location:

Working onsite at our Santa Clara, CA headquarters 3 days per week - Hybrid.

We are seeking a skilled and experienced Staff Software Engineer to contribute to the architecture and development of our next-generation AI inference runtime. The ideal candidate will have a strong background in C++ development, with experience in building distributed systems or high-performance computing (HPC) applications. Familiarity with PyTorch internals or similar machine learning frameworks is a significant advantage.

What You Will Do:

  • Architect and Develop: Lead the design and implementation of a high-performance inference runtime that leverages d-Matrix's advanced hardware capabilities.
  • Integrate Frameworks: Integrate the inference runtime with PyTorch to enable upstream software capabilities like inference and finetuning.
  • Collaborate: Work closely with cross-functional teams including hardware engineers, data scientists, and product managers to define requirements and deliver integrated solutions.
  • Optimize Performance: Develop and implement optimization techniques to ensure low latency and high throughput in distributed and HPC environments.
  • Code Quality: Ensure the code quality, and performance through rigorous testing and code reviews.
  • Documentation: Create technical documentation to support development, deployment, and maintenance activities.

What You Will Bring:

  • Education: Bachelor’s with a minimum of 6+ years of professional experience in software development with a focus on C++, Master’s degree preferred in computer science, Engineering, or a related field with 3+ years of professional experience in software development with a focus on C++

oExperience in architecting and building complex software systems.

oExperience with distributed systems or high-performance computing (HPC) applications.

oFamiliarity with PyTorch internals or similar machine learning frameworks.

•Technical Skills:

oStrong proficiency in modern C++ (C++11 and above) and Python.

oSolid understanding of software design patterns and best practices.

oExperience with parallel and concurrent programming.

oProficient in CMake, Pytest, and other development tools.

oKnowledge of GPU programming and acceleration techniques is a plus.

oProficient in using development tools and frameworks for building and deploying large-scale applications.

•Soft Skills:

oExcellent problem-solving and analytical skills.

oStrong communication and interpersonal abilities.

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Senior
Manager

Salary

Salary: 142k-230k USD

Location requirements

Hiring timezones

United States +/- 0 hours

About d-Matrix

Learn more about d-Matrix and their company culture.

View company profile

d-Matrix is a revolutionary company founded in 2019, focused on delivering cutting-edge AI computing solutions specifically tailored for generative AI applications at scale. The company has created its flagship product, Corsair™, which is recognized as the world’s most efficient AI inference platform for data centers. By taking a unique approach that combines high performance with sustainability, d-Matrix is dedicated to transforming the way AI is utilized in commercial settings.

The leadership of d-Matrix includes experienced entrepreneurs who have a history of success in the semiconductor industry, collectively boasting over 20 years of expertise and the accomplishment of shipping over 100 million chips while generating substantial revenues exceeding $1 billion. With significant backing from investors, including Microsoft, d-Matrix is positioned as a key player in the AI semiconductor landscape, aiming to make AI inference not only viable but also accessible to a wider range of applications and businesses.

Claim this profiled-Matrix logoD-

d-Matrix

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

24 remote jobs at d-Matrix

Explore the variety of open remote roles at d-Matrix, offering flexible work options across multiple disciplines and skill levels.

View all jobs at d-Matrix

Remote companies like d-Matrix

Find your next opportunity by exploring profiles of companies that are similar to d-Matrix. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan