GPU Cluster Architect

Job not on LinkedIn

🔥 14 hours ago

🇺🇸 United States – Remote

💵 $184k - $318k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏛️ Architect

👻 Ghost score 20%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Nebius Group

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Artificial Intelligence • Enterprise • SaaS

Nebius Group is building one of the world’s leading AI infrastructure companies, focusing on providing the necessary compute, storage, and tools for developers in the AI space. Based in Europe and listed on Nasdaq, Nebius has a global presence with R&D centers across Europe, North America, and Israel. The company's primary offering is an AI-centric cloud platform designed for intensive AI workloads, complemented by various other businesses involved in generative AI development, edtech, and autonomous technology.

📋 Description

• Architect scalable GPU cluster topologies including compute nodes, InfiniBand/Ethernet interconnects, storage, and control planes • Analyze AI/ML workloads such as LLM training and inference to inform latency, bandwidth, and GPU-density tradeoffs • Align with network architects and validate low-latency, high-throughput interconnects such as InfiniBand HDR/NDR and RoCEv2 at POD and data-center scale • Work with storage teams to optimize performance for training datasets and checkpointing • Analyze monitoring-system signals to detect design flaws • Partner with site reliability, networking, storage, and data-center engineering teams to operationalize and scale the architecture

🎯 Requirements

• 5+ years of experience designing clusters • Deep understanding of modern GPU architecture, including NVIDIA and AMD • Experience with HPC interconnects, including InfiniBand and RoCE • Solid background in systems architecture, networking, and hardware reliability • Experience scripting for automation and telemetry pipelines using Python, Go, or similar • Must be authorized to work in the United States and provide proof of employment eligibility

🏖️ Benefits

• 100% company-paid medical, dental, and vision coverage for employees and families • 401(k) plan with up to 4% company match and immediate vesting • 20 weeks paid parental leave for primary caregivers • 12 weeks paid parental leave for secondary caregivers • Remote work reimbursement up to $85/month for mobile and internet • Company-paid short-term, long-term, and life insurance coverage • Equity in the form of RSUs may be available at certain salary grades • Opportunities for professional growth within Nebius • Hybrid working arrangements • Competitive salary and comprehensive benefits package • Career growth and learning opportunities • Flexibility and ownership • Collaborative and innovative culture • Opportunity to work on impactful AI projects • International environment and talented teams