AI Cluster Architect

🕒 August 6

🇺🇸 United States – Remote

💵 $200k - $220k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 Artificial Intelligence

👻 Ghost score 47%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.Why this score:

• Open for 98 days.
• Jobs at this company usually fill in 41 days.
• Reposted once.
• 48 open roles for a team of 74.

Apply Now

Find Similar Remote Jobs

Vultr

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2014

🤖 Artificial Intelligence

Cloud Computing • Artificial Intelligence

Vultr is a cloud infrastructure provider offering a wide range of services including compute instances, storage, managed databases, and GPU clusters. The company focuses on providing high-performance and accessible cloud solutions, leveraging both AMD and NVIDIA technologies to power applications in artificial intelligence, high-performance computing, and general workloads. Vultr offers services that are designed to be simpler and more cost-effective than major competitors like AWS, GCP, and Azure, with global data center locations to support diverse deployment needs.

📋 Description

• Architect large-scale GPU clusters within fixed site power budgets, optimizing for maximum GPU density while reserving headroom for compute services, storage, and networking • Model and validate power consumption across the full cluster bill of materials, including GPUs, CPUs, NICs, switches, fabric components, storage, and facility limits • Evaluate tradeoffs across InfiniBand, RoCE, and SpectrumX networking architectures, including multi-plane, 2-tier/3-tier, and rail-optimized topologies • Determine network scale limits based on switch radix, link speed, topology, and blocking requirements • Gather, interpret, and maintain SKU-level power and thermal specifications for GPUs, NICs, switches, DPUs, storage, and server platforms • Develop power-aware cluster configuration templates and capacity-planning models for sites with varying constraints • Document architecture, design choices, tradeoff analyses, and operational considerations for deployment and lifecycle management • Provide guidance on incorporating next-generation GPUs, NICs, and fabrics • Collaborate with vendors on novel fabric architectures enabling large-scale cluster deployments of 100k+ GPUs

🎯 Requirements

• 7+ years designing or building large-scale HPC, AI, or hyperscale GPU clusters • Expert understanding of GPU and accelerator system design, including node topology, PCIe/NVLink/NVSwitch/ROCm, and NIC-to-GPU affinity considerations • Strong familiarity with InfiniBand, RoCE, and SpectrumX networking, including multi-tier, multi-plane, Clos/dragonfly variants, and large-radix switch design • Demonstrated experience modeling power draw and thermal characteristics of servers, GPUs, NICs, switches, optics, and storage systems • Ability to design networks that maintain full non-blocking performance or intentionally introduce over/under-subscription while understanding impacts on workload performance • Proven ability to gather and analyze vendor SKU-level specifications and incorporate them into scalable cluster architectures • Experience balancing customer-driven requirements for compute, storage, and service density in combination with overall GPU count • Strong documentation, communication, and cross-functional collaboration skills

🏖️ Benefits

• 100% company-paid insurance premiums for employee medical, dental and vision plans • 401(k) plan that matches 100% up to 4%, with immediate vesting • Professional Development Reimbursement of $2,500 each year • 11 Holidays + Paid Time Off Accrual + Rollover Plan • Increased PTO at 3 year and 10 year anniversary • 1 month paid sabbatical every 5 years • Anniversary Bonus each year • $500 stipend for remote office setup in first year + $400 each following year • Internet reimbursement up to $75 per month • Gym membership reimbursement up to $50 per month • Company paid Wellable subscription

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume