ML Infrastructure Engineer

Job not on LinkedIn

🕒 May 12

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

Where this job comes from

Posted on Nebius Group's careers page ↗Nebius Group's careers page, not through a job board

First seen by Remote Rocketship May 12

Still open on Nebius Group's site. Checked 6 hours ago.

Apply Now
Logo of Nebius Group

Nebius Group

1001 - 5000 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Artificial Intelligence • Enterprise • SaaS

Nebius Group is building one of the world’s leading AI infrastructure companies, focusing on providing the necessary compute, storage, and tools for developers in the AI space. Based in Europe and listed on Nasdaq, Nebius has a global presence with R&D centers across Europe, North America, and Israel. The company's primary offering is an AI-centric cloud platform designed for intensive AI workloads, complemented by various other businesses involved in generative AI development, edtech, and autonomous technology.

📋 Description

• Work closely with hardware, development teams to profile and analyse GPU performance at the system and kernel level. • Evaluate and compare GPU performance across different platforms, architectures, and software stacks (e.g.,CUDA, ROCm). • Debug and optimise ML workloads to run efficiently on GPU hardware, identifying and resolving performance bottlenecks. • Perform acceptance testing for new GPU clusters, ensuring hardware and software meet performance, stability, and compatibility requirements for AI workloads. • Perform experiments across diverse GPU system configurations to assess the impact of varying interconnect strategies and system-level optimisations on performance and scalability. • Develop tools and dashboards to visualise performance metrics, bottlenecks, and trends. • Contribute to internal tooling, frameworks, and best practices

🎯 Requirements

• A profound understanding of theoretical foundations of machine learning • Deep understanding of performance aspects of large neural networks training and inference (data/tensor/context/expert parallelism, offloading, custom kernels, hardware features, attention optimisations, dynamic batching etc.) • Deep experience with modern deep learning frameworks (PyTorch, JAX, Megatron-LM, Tensort-LLM) • Good understanding of the GPU stack: CUDA,NCCL, drivers, and relevant libraries • Familiarity with containerized environments (e.g., Docker, Kubernetes). • Strong communication and ability to work independently

🏖️ Benefits

• Competitive compensation • Career growth and learning opportunities • Flexibility and work-life balance • Collaborative and innovative culture • Opportunity to work on impactful AI projects • International environment and talented teams

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 April 28

Bayesian Health

11 - 50

🏥 Healthcare

🤖 Artificial Intelligence

⚕️ Healthcare Insurance

Infrastructure Engineer building infrastructure and developing CI/CD for clinical AI/ML platform at Bayesian Health. Collaborating with cross-functional teams to ensure reliable and scalable systems.

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

🕒 April 20

Tavus

1 - 10

🤖 Artificial Intelligence

📱 Media

Senior Software Engineer managing GPU and cloud infrastructure for AI Humans at Tavus. Collaborating across teams for reliable deployments and empowering engineering experiences.

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

🕒 April 16

Hyperbolic

1 - 10

🤖 Artificial Intelligence

☁️ SaaS

Serve as technical contact running infra performance tests and diagnosing issues for an AI cloud platform. Engage in customer trials and benchmark workloads for GPU performance.

🕒 April 16

Airwallex

1001 - 5000

💳 Fintech

💸 Finance

Senior Software Engineer designing and operating AI agents to automate infrastructure workflows. Working with the Infrastructure & Productivity team to improve global engineering operations at Airwallex.

🇺🇸 United States – Remote

💵 $140k - $240k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

🕒 April 9

Cresta

51 - 200

☁️ SaaS

🤖 Artificial Intelligence

🏢 Enterprise

Senior Infrastructure Engineer/SRE responsible for building core infrastructure at AI-driven contact center company. Designing tools for developers and ensuring reliability across cloud platforms.

🇺🇸 United States – Remote

💵 $205k - $270k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok