Himalayas logo
DDNDD

Sr Machine Learning Engineer - Infinia AI Performance

DataDirect Networks (DDN) is a leading provider of high-performance data storage and management solutions, specializing in AI and HPC applications.

DDN

Employee count: 1001-5000

United States only

Overview

This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial services, autonomous cars, Government, academia, research and manufacturing.

"DDN's A3I solutions are transforming the landscape of AI infrastructure." – IDC

“The real differentiator is DDN. I never hesitate to recommend DDN. DDN is the de facto name for AI Storage in high performance environments” - Marc Hamilton, VP, Solutions Architecture & Engineering | NVIDIA

DDN is the global leader in AI and multi-cloud data management at scale. Our cutting-edge data intelligence platform is designed to accelerate AI workloads, enabling organizations to extract maximum value from their data. With a proven track record of performance, reliability, and scalability, DDN empowers businesses to tackle the most challenging AI and data-intensive workloads with confidence.

Our success is driven by our unwavering commitment to innovation, customer-centricity, and a team of passionate professionals who bring their expertise and dedication to every project. This is a chance to make a significant impact at a company that is shaping the future of AI and data management.

Our commitment to innovation, customer success, and market leadership makes this an exciting and rewarding role for a driven professional looking to make a lasting impact in the world of AI and data storage.

Job Description

We are seeking a talented and experienced Sr ML Engineer to help us optimize training, inference, and Retrieval-Augmented Generation (RAG) pipelines for high-performance AI applications. You will lead the development of connectors to open-source frameworks for data streaming, such as, Mosaic Streaming, Ray Data, and Tf.Data and inference optimizations such as K-V caching and LORAX. You will guide a talented organization of engineers focused on advanced end-to-end data platform for ingestion, transformation, preparation, and streaming on high-performance AI applications. Collaborating closely with software developers, product teams, and partners, you will lead experiments with state-of-the-art models using open-source tools and cloud platforms.

Key Responsibilities:

  • Design and implement integration of data ingestion and streaming pipelines with open-source tools, like Ray Data, Mosaic Streaming, Tf.data, Torch Dataloader.
  • Design of optimization for training like asynchronous checkpointing, and inference, like K-V caching and LORAX.
  • Guide the integration of MLFlow with DDN’s Infinia product for comprehensive experiment tracking, model versioning, and deployment.
  • Drive the implementation and scaling of Retrieval-Augmented Generation (RAG) pipelines to enhance generative model performance.
  • Stay abreast of the latest developments in AIOps, AI frameworks, optimization, and accelerated execution.
  • Identify and implement solutions to optimize training and inference pipeline performance, runtime, and resource utilization on Infinia.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Machine Learning, or related fields.
  • 5+ years of experience in machine learning operations (MLOps) or related roles.
  • Proven expertise in building and scaling AI/ML pipelines.
  • Strong understanding of machine learning frameworks and libraries (TensorFlow, PyTorch, NVIDIA NeMo, vLLM, TensorRT-LLM).
  • Experience in deploying open-source vector databases at scale.
  • Solid understanding of cloud infrastructure (AWS, GCP, Azure) and distributed computing.
  • Proficiency with containerization tools (Docker, Kubernetes) and infrastructure as code.
  • Excellent problem-solving and troubleshooting skills, with attention to detail and performance optimization.
  • Strong communication and collaboration skills.

Preferred Qualifications:

  • Implementation-level understanding of ML frameworks, data loaders and data formats.
  • Experience with scaling RAG pipelines and integrating them with generative AI models.
  • Experience in operationalizing AI/ML models in production environments.

This position requires participation in an on-call rotation to provide after-hours support as needed.

DDN

Join our dynamic and driven team, where engineering excellence is at the heart of everything we do. We seek individuals who love to challenge themselves and are fueled by curiosity. Here, you'll have the opportunity to work across various areas of the company, thanks to our flat organizational structure that encourages hands-on involvement and direct contributions to our mission. Leadership is earned by those who take initiative and consistently deliver outstanding results, both in their work ethic and deliverables, making strong prioritization skills essential. Additionally, we value strong communication skills in all our engineers and researchers, as they are crucial for the success of our teams and the company as a whole.

Interview Process: After submitting your application, one of our recruiters will review your resume. If your application passes this stage, you will be invited to a 30-minute interview during which a member of our team will ask some basic questions. If you clear the interview, you will enter the main process, which can consist of up to four interviews in total:

  • Coding assessment: Often in a language of your choice.
  • Systems design: Translate high-level requirements into a scalable, fault-tolerant service (depending on role).
  • Real-time problem-solving: Demonstrate practical skills in a live problem-solving session.
  • Meet and greet with the wider team.
  • Our goal is to finish the main process in 2-3 weeks at most.

DataDirect Networks (DDN) is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity, gender expression, transgender, sex stereotyping, sexual orientation, national origin, disability, protected Veteran Status, or any other characteristic protected by applicable federal, state, or local law.

About the job

Apply before

Posted on

Job type

Full Time

Experience level

Senior

Location requirements

Hiring timezones

United States +/- 0 hours

About DDN

Learn more about DDN and their company culture.

View company profile

At the heart of what we do is a culture of innovation and dedication to empowering businesses around the globe with cutting-edge data solutions. Since our inception in 1998, DataDirect Networks (DDN) has pioneered advancements in data storage and management, focusing on high-performance computing (HPC) environments and artificial intelligence (AI) applications. With over two decades of dedicated service, we understand the challenges organizations face when handling massive datasets and have developed a comprehensive platform that enhances operational efficiency, reliability, and scalability.

Our esteemed leaders, including co-founders Alex Bouzari and Paul Bloch, have built DDN into a respected global entity, known for its commitment to transforming IT infrastructures through intelligent data management strategies. DDN is trusted by over 11,000 customers, including premier organizations across healthcare, finance, automotive, and education. We pride ourselves on our innovative spirit, exemplified by our continuous investment in research and development, with more than $500 million allocated to ensuring we remain at the forefront of technology.

Claim this profileDDN logoDD

DDN

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

17 remote jobs at DDN

Explore the variety of open remote roles at DDN, offering flexible work options across multiple disciplines and skill levels.

View all jobs at DDN

Remote companies like DDN

Find your next opportunity by exploring profiles of companies that are similar to DDN. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
DDN hiring Sr Machine Learning Engineer - Infinia AI Performance • Remote (Work from Home) | Himalayas