Senior Compute Infrastructure Engineer

🔥 15 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

Where this job comes from

Posted on StackYak's careers page ↗StackYak's careers page, not through a job board

First seen by Remote Rocketship 15 minutes ago

Apply Now
Logo of StackYak

StackYak

2 - 10 employees

🤖 Artificial Intelligence

☁️ SaaS

🤝 B2B

Artificial Intelligence • SaaS • B2B

StackYak is an AI infrastructure orchestration platform that combines inference, GPU compute, and private networking into a single control plane. It provides hosted inference and dedicated GPU capacity, built-in private connectivity, and observability so teams can move models from testing to production without stitching together separate vendors. The platform targets developers, enterprises, and MSPs/resellers, and plans to add storage and security layers in future releases.

📋 Description

• Define the GPU fleet strategy, including owned versus rented capacity, standardization, and cost • Manage Linux, kernel, firmware, drivers, CUDA and/or ROCm across GPU machines • Own the boundary between bare metal, virtual machines, and containers • Design and validate customer and workload isolation • Automate provisioning, rebuilding, and recovery of remote machines • Integrate neocloud and other compute-provider APIs and capacity • Specify hardware and coordinate its path from purchase order to booting machine through vendors, data-center partners, and remote hands • Diagnose failures spanning hardware, firmware, operating systems, virtualization, storage, networking, and workloads • Build operational tooling so others can operate the fleet • Design, build, debug, and operate production infrastructure • Help determine workload placement, machine recovery, owned versus rented capacity, standardization, platform coherence, and productized infrastructure capabilities • Participate in technical decisions and shared production/on-call responsibility

🎯 Requirements

• Deep production Linux experience, including kernel-level troubleshooting • Experience operating GPU infrastructure for AI, HPC, cloud, or similarly demanding workloads • Experience with NVIDIA and/or AMD platforms, including difficult driver or firmware upgrades • Experience provisioning bare metal at scale without manual configuration • Experience managing and recovering machines that cannot be physically accessed • Experience choosing between bare metal, KVM, and containers for consequential workloads • Production experience writing Terraform and Python tooling • Experience hardening hosts and isolating customer workloads • Experience debugging failures across hardware, firmware, OS, drivers, networking, and workloads • Experience with neoclouds, hyperscalers, GPU clouds, HPC environments, hosting companies, data-center operators, or AI infrastructure companies is especially strong • Experience operating mixed owned and rented capacity is especially strong • Experience with multi-GPU and multi-node systems is especially strong • Understanding of NUMA, PCIe topology, RDMA, NIC placement, and physical topology for AI workloads is especially strong • Experience specifying or accepting hardware is especially strong • Experience designing multi-customer infrastructure is especially strong • Experience working outside tightly siloed enterprise teams is especially strong • No specific degree, certification, or academic credential required

🏖️ Benefits

• Meaningful equity • Employment or contract engagement depending on location • Remote and distributed work across time zones • Direct access to founders • Participation in technical decisions • Shared responsibility for production and on-call • A few real conversations with the people you would actually work with instead of a recruiter screen and panel • Competitive compensation

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 2 days ago

Runware

11 - 50

🤖 Artificial Intelligence

🔌 API

📱 Media

Senior Staff Engineer owning GPU drivers, CUDA, Kubernetes, and diagnostics for Runware's AI supercomputer. Building reliable GPU infrastructure, automated fault recovery, and fleet-wide software baselines.

🕒 2 days ago

Renalogic

51 - 200

🏥 Healthcare

💼 Consulting

🛡️ Insurance

IT Infrastructure Engineer leading Zero Trust, cloud infrastructure, and automation for Renalogic’s chronic kidney disease care platform. Fully remote role protecting PHI and supporting HIPAA and SOC 2 compliance.

🕒 2 days ago

Pirate Ship

51 - 200

📦 Logistics

🛍️ eCommerce

☁️ SaaS

Senior IT Infrastructure Engineer managing enterprise infrastructure, IAM, and Google Workspace for Pirate Ship’s shipping software. Remote role focused on reliability, security, automation, and disaster recovery.

🕒 3 days ago

Buzz Solutions

11 - 50

⚡ Energy

🤖 Artificial Intelligence

🔐 Security

Senior Systems & Infrastructure Engineer operating cloud infrastructure for Buzz Solutions’ AI-powered power-grid inspection platform. Scaling secure data pipelines, Kubernetes, observability and model-serving systems.

🕒 3 days ago

SouthEast Alaska Regional Health Consortium (SEARHC)

1001 - 5000

⚕️ Healthcare Insurance

🏥 Healthcare

🧘 Wellness

Infrastructure Engineer administering SEARHC’s hybrid healthcare infrastructure, cloud, virtualization, security, and disaster recovery systems. Supporting mission-critical clinical and business services across Southeast Alaska.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok