
2 - 10 employees
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
StackYak is an AI infrastructure orchestration platform that combines inference, GPU compute, and private networking into a single control plane. It provides hosted inference and dedicated GPU capacity, built-in private connectivity, and observability so teams can move models from testing to production without stitching together separate vendors. The platform targets developers, enterprises, and MSPs/resellers, and plans to add storage and security layers in future releases.
🔥 15 minutes ago
Where this job comes from
Posted on StackYak's careers page ↗, not through a job board
First seen by Remote Rocketship 15 minutes ago

2 - 10 employees
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
StackYak is an AI infrastructure orchestration platform that combines inference, GPU compute, and private networking into a single control plane. It provides hosted inference and dedicated GPU capacity, built-in private connectivity, and observability so teams can move models from testing to production without stitching together separate vendors. The platform targets developers, enterprises, and MSPs/resellers, and plans to add storage and security layers in future releases.
• Define the GPU fleet strategy, including owned versus rented capacity, standardization, and cost • Manage Linux, kernel, firmware, drivers, CUDA and/or ROCm across GPU machines • Own the boundary between bare metal, virtual machines, and containers • Design and validate customer and workload isolation • Automate provisioning, rebuilding, and recovery of remote machines • Integrate neocloud and other compute-provider APIs and capacity • Specify hardware and coordinate its path from purchase order to booting machine through vendors, data-center partners, and remote hands • Diagnose failures spanning hardware, firmware, operating systems, virtualization, storage, networking, and workloads • Build operational tooling so others can operate the fleet • Design, build, debug, and operate production infrastructure • Help determine workload placement, machine recovery, owned versus rented capacity, standardization, platform coherence, and productized infrastructure capabilities • Participate in technical decisions and shared production/on-call responsibility
• Deep production Linux experience, including kernel-level troubleshooting • Experience operating GPU infrastructure for AI, HPC, cloud, or similarly demanding workloads • Experience with NVIDIA and/or AMD platforms, including difficult driver or firmware upgrades • Experience provisioning bare metal at scale without manual configuration • Experience managing and recovering machines that cannot be physically accessed • Experience choosing between bare metal, KVM, and containers for consequential workloads • Production experience writing Terraform and Python tooling • Experience hardening hosts and isolating customer workloads • Experience debugging failures across hardware, firmware, OS, drivers, networking, and workloads • Experience with neoclouds, hyperscalers, GPU clouds, HPC environments, hosting companies, data-center operators, or AI infrastructure companies is especially strong • Experience operating mixed owned and rented capacity is especially strong • Experience with multi-GPU and multi-node systems is especially strong • Understanding of NUMA, PCIe topology, RDMA, NIC placement, and physical topology for AI workloads is especially strong • Experience specifying or accepting hardware is especially strong • Experience designing multi-customer infrastructure is especially strong • Experience working outside tightly siloed enterprise teams is especially strong • No specific degree, certification, or academic credential required
• Meaningful equity • Employment or contract engagement depending on location • Remote and distributed work across time zones • Direct access to founders • Participation in technical decisions • Shared responsibility for production and on-call • A few real conversations with the people you would actually work with instead of a recruiter screen and panel • Competitive compensation
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🕒 2 days ago
Senior Staff Engineer owning GPU drivers, CUDA, Kubernetes, and diagnostics for Runware's AI supercomputer. Building reliable GPU infrastructure, automated fault recovery, and fleet-wide software baselines.
🕒 2 days ago
IT Infrastructure Engineer leading Zero Trust, cloud infrastructure, and automation for Renalogic’s chronic kidney disease care platform. Fully remote role protecting PHI and supporting HIPAA and SOC 2 compliance.
🕒 2 days ago
Senior IT Infrastructure Engineer managing enterprise infrastructure, IAM, and Google Workspace for Pirate Ship’s shipping software. Remote role focused on reliability, security, automation, and disaster recovery.
🕒 3 days ago
Senior Systems & Infrastructure Engineer operating cloud infrastructure for Buzz Solutions’ AI-powered power-grid inspection platform. Scaling secure data pipelines, Kubernetes, observability and model-serving systems.
🕒 3 days ago
1001 - 5000
⚕️ Healthcare Insurance
🏥 Healthcare
🧘 Wellness
Infrastructure Engineer administering SEARHC’s hybrid healthcare infrastructure, cloud, virtualization, security, and disaster recovery systems. Supporting mission-critical clinical and business services across Southeast Alaska.