Senior Infrastructure Engineer – GPU Compute

Job not on LinkedIn

🔥 16 minutes ago

🇺🇸 United States – Remote

💵 $175k - $250k / year

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

Where this job comes from

Posted on Boundless's careers page, not through a job board

First seen by Remote Rocketship 16 minutes ago

Logo of Boundless

Boundless

1 - 10 employees

Founded 2012

💼 Consulting

🛍️ eCommerce

☁️ SaaS

Consulting • eCommerce • SaaS

Boundless is a domain registration and web hosting service provider that facilitates businesses and individuals in acquiring and managing their online presence. They offer a range of domain name extensions and web hosting plans, making it easy for users to find the right fit for personal, professional, or eCommerce projects. Additionally, Boundless provides SSL certificates and support services to ensure a secure and functional online experience.

📋 Description

• Build and operate the compute fabric powering AI inference workloads • Operate a heterogeneous, multi-region GPU fleet spanning consumer and datacenter hardware, including RTX 5090 • Use SkyPilot, Kubernetes/k3s, and cloud and on-premises providers to orchestrate workloads • Build reliable scheduling patterns for inference workloads across the fleet • Maximize GPU utilization across inference workloads • Own workload placement across spot, on-premises, and cloud capacity • Keep the always-on inference substrate saturated and economical • Optimize GPU performance through PCIe P2P, ReBAR, NUMA topology, CUDA/driver tuning, memory configuration, and network topology • Build secure fleet access using Tailscale and Teleport • Develop observability and alerting systems • Execute zero-downtime rollouts across a distributed node fleet • Reduce cost per GPU-hour through spot instance management, workload placement, and resource scheduling

🎯 Requirements

• 5+ years of infrastructure/DevOps experience operating large-scale production systems • Deep expertise in Kubernetes, Docker, and container orchestration at scale • Strong Linux systems administration skills • Proficiency in infrastructure-as-code tools including Terraform, Ansible, and Pulumi • Track record of managing mission-critical, high-throughput systems • Strong infrastructure-as-code background in heterogeneous environments • Proficiency in at least one scripting or programming language, such as Python, Bash, TypeScript, or Go • Comfort navigating ambiguity with a strong bias for action • Candidates must include a public GitHub profile in their application • GitHub profile must demonstrate a minimum of 1 year of activity/history • Applications without a GitHub profile or with insufficient activity will not be considered • GPU computing infrastructure experience, including CUDA, bare-metal optimization, and kernel tuning • Experience operating ML training or other large-scale distributed compute infrastructure • Experience with GPU fleet orchestration, such as SkyPilot, Ray, or Slurm • Familiarity with fleet access and networking tooling, such as Tailscale and Teleport • Knowledge of network optimization and topology design • Experience with multi-region, globally distributed systems • Proficiency in Rust or low-level systems programming • Experience with on-premises data center operations

🏖️ Benefits

• Equity allocation • Health, dental, and vision insurance for U.S. employees; region-adjusted globally • Flexible PTO • Professional development budget • Conference travel budget • Remote-first work arrangement • Regular off-sites • High-trust, high-velocity team environment

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 4 hours ago

Temporal Technologies

51 - 200

💼 Consulting

🏭 Manufacturing

📣 Marketing

Senior infrastructure engineer scaling Temporal’s cloud workflow platform. Building cost-efficient, reliable systems across compute, networking, orchestration, and observability.

🔥 4 hours ago

ProductLife Group

1001 - 5000

💼 Consulting

🏥 Healthcare

💊 Pharmaceuticals

Infrastructure Architect leading Azure, Microsoft 365, and Generative AI transformation at ProductLife Group. Driving secure enterprise architecture, governance, and technology modernization across global life sciences operations.

🔥 5 hours ago

Conduent

10,000+ employees

🏥 Healthcare

📦 Logistics

💼 Consulting

Infrastructure Systems Engineer delivering resilient Windows and cloud infrastructure solutions for Conduent’s Fortune 100 and government clients. Leading automation, high availability, disaster recovery, and technical project delivery.

🔥 5 hours ago

Conduent

10,000+ employees

🏥 Healthcare

📦 Logistics

💼 Consulting

Infrastructure Systems Engineer delivering resilient Windows and cloud infrastructure solutions for Conduent’s mission-critical client services. Automating deployments, leading projects, and producing operational designs and documentation.

🔥 5 hours ago

Tessera Labs

11 - 50

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

AI infrastructure engineer building Kubernetes, cloud, and LLM tooling for Tessera Labs’ enterprise multi-agent AI platform. Operating production agent infrastructure across customer environments.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok