GPU Cluster Architect

Job not on LinkedIn

🕒 September 28

🇺🇸 United States – Remote

💵 $184k - $318k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🏛️ Architect

👻 Ghost score 21%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Open for 46 days.
• Jobs at this company usually fill in 60 days.
• 130 open roles for a team of 107.

Apply Now

Customize resume + cover letter

Find Similar Remote Jobs

☆ Save☑️ Mark as applied❌ Hide

Report problem

Nebius Group

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Artificial Intelligence • Enterprise • SaaS

Nebius Group is building one of the world’s leading AI infrastructure companies, focusing on providing the necessary compute, storage, and tools for developers in the AI space. Based in Europe and listed on Nasdaq, Nebius has a global presence with R&D centers across Europe, North America, and Israel. The company's primary offering is an AI-centric cloud platform designed for intensive AI workloads, complemented by various other businesses involved in generative AI development, edtech, and autonomous technology.

📋 Description

• Architect scalable GPU cluster topologies including compute nodes, InfiniBand/Ethernet interconnects, storage, and control planes • Analyze AI/ML workloads such as LLM training and inference to inform latency, bandwidth, and GPU-density tradeoffs • Align with network architects and validate low-latency, high-throughput interconnects such as InfiniBand HDR/NDR and RoCEv2 at POD and data-center scale • Work with storage teams to optimize performance for training datasets and checkpointing • Analyze monitoring-system signals to detect design flaws • Partner with site reliability, networking, storage, and data-center engineering teams to operationalize and scale the architecture

🎯 Requirements

• 5+ years of experience designing clusters • Deep understanding of modern GPU architecture, including NVIDIA and AMD • Experience with HPC interconnects, including InfiniBand and RoCE • Solid background in systems architecture, networking, and hardware reliability • Experience scripting for automation and telemetry pipelines using Python, Go, or similar • Must be authorized to work in the United States and provide proof of employment eligibility

🏖️ Benefits

• 100% company-paid medical, dental, and vision coverage for employees and families • 401(k) plan with up to 4% company match and immediate vesting • 20 weeks paid parental leave for primary caregivers • 12 weeks paid parental leave for secondary caregivers • Remote work reimbursement up to $85/month for mobile and internet • Company-paid short-term, long-term, and life insurance coverage • Equity in the form of RSUs may be available at certain salary grades • Opportunities for professional growth within Nebius • Hybrid working arrangements • Competitive salary and comprehensive benefits package • Career growth and learning opportunities • Flexibility and ownership • Collaborative and innovative culture • Opportunity to work on impactful AI projects • International environment and talented teams

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume