Senior ML Engineer

The role

AI Studio is a part of Nebius Cloud, one of the world’s largest GPU clouds, running tens of thousands of GPUs. We are building an inference fine-tuning platform that makes every kind of foundation model — text, vision, audio, and emerging multimodal architectures — fast, reliable, and effortless to train deploy at massive scale.

This role will require expertise in distributed LLMs training and inference.

Your responsibilities will include:

• Enhancing fine-tuning methodologies - both LoRA-based and full-parameter - for cutting-edge LLMs (e.g., GPT-OSS, Kimi K2, DeepSeek V3/R1, GLM-4.5), focusing on both model quality and training efficiency

• Researching and implementing advanced inference optimization techniques, such as speculative decoding, quantization, and large-scale draft model training

• Re-implementing state-of-the-art open-source LLM architectures in JAX

We expect you to have:

• A profound understanding of theoretical foundations of machine learning and reinforcement learning.

• Deep expertise in modern deep learning for language processing and generation

• Substantial experience with training large models on multiple computational nodes

• Reasonable understanding of performance aspects of large neural network training (sharding strategies, custom kernels, hardware features etc.)

• Strong software engineering skills (we mostly use Python)

• Deep experience with modern deep learning frameworks (we use JAX)

• Proficiency in contemporary software engineering approaches, including CI/CD, version control and unit testing

• Strong communication and leadership abilities

Nice to have:

• Previous experience working with language models or other similar NLP technologies.

• Familiarity with important ideas in LLM space, such as MHA, RoPE, ZeRO/FSDP, Flash Attention, quantization

• A track record of building and delivering products (not necessarily ML-related) in a dynamic startup-like environment.

• Strong engineering skills, including experience in developing large distributed systems or high-load web services.

• Open-source projects that showcase your engineering prowess

• Excellent command of the English language, alongside superior writing, articulation, and communication skills.