AI Cluster Architect

🕒 August 6

🇺🇸 United States – Remote

💵 $165k - $185k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 Artificial Intelligence

👻 Ghost score 2%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Vultr

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2014

🤖 Artificial Intelligence

🤝 B2B

🔧 Hardware

💰 $329M Debt Financing - Vultr on 2025-06

Artificial Intelligence • B2B • Hardware

Vultr is a global cloud infrastructure provider offering on-demand virtual machines, bare-metal servers, GPU-accelerated instances, managed databases, object and block storage, Kubernetes, and networking services. The platform emphasizes AI and HPC workloads with a broad selection of AMD and NVIDIA GPUs, fast networking, and 32+ data center regions, plus a marketplace of deployable apps and developer-friendly APIs. Vultr targets developers and businesses seeking affordable, scalable, and compliant cloud compute and storage alternatives to hyperscalers.

📋 Description

• Architect large-scale GPU clusters within fixed site power budgets to maximize GPU density while reserving headroom for compute services, storage, and networking • Model and validate power consumption across GPUs, CPUs, NICs, switches, fabric components, storage, and facility limits • Evaluate InfiniBand, RoCE, and SpectrumX networking architectures, including multi-plane, 2-tier/3-tier, and rail-optimized topologies • Determine network scale limits based on switch radix, link speed, topology, and blocking requirements • Gather, interpret, and maintain SKU-level power and thermal specifications for GPUs, NICs, switches, DPUs, storage, and server platforms • Develop power-aware cluster configuration templates and capacity-planning models for sites with varying constraints • Document architecture, design choices, tradeoff analyses, and operational considerations for deployment and lifecycle management • Provide guidance on incorporating next-generation GPUs, NICs, and fabrics • Collaborate with vendors on novel fabric architectures for large-scale cluster deployments of 100k+ GPUs

🎯 Requirements

• 7+ years designing or building large-scale HPC, AI, or hyperscale GPU clusters • Expert understanding of GPU and accelerator system design, including node topology, PCIe, NVLink, NVSwitch, ROCm, and NIC-to-GPU affinity • Strong familiarity with InfiniBand, RoCE, and SpectrumX networking • Experience with multi-tier, multi-plane, Clos/dragonfly variants, and large-radix switch design • Demonstrated experience modeling server, GPU, NIC, switch, optics, and storage power draw and thermal characteristics • Ability to design fully non-blocking networks or intentionally introduce over-/under-subscription while understanding workload-performance impacts • Proven ability to gather and analyze vendor SKU-level specifications and incorporate them into scalable cluster architectures • Experience balancing customer-driven compute, storage, and service-density requirements with overall GPU count • Strong documentation, communication, and cross-functional collaboration skills • Must be located in a U.S. state and legally authorized to work in the United States • Must answer whether employment-visa sponsorship is currently or potentially required

🏖️ Benefits

• Excellent Medical Benefits with 100% company-paid premiums for employee-only plan • 100% company-paid dental and vision premiums • 401(k) plan matching 100% up to 4% with immediate vesting • Professional Development Reimbursement of $2,500 each year • 11 Holidays • Paid Time Off Accrual • PTO Rollover Plan • Take your birthday off • Increased PTO at 3-year and 10-year anniversaries • 1 month paid sabbatical every 5 years • Anniversary Bonus each year • $500 first-year remote office setup • $400 each following year for new equipment • Internet reimbursement up to $75 per month • Gym membership reimbursement up to $50 per month • Company-paid Wellable subscription