
2 - 10 employees
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
StackYak is an AI infrastructure orchestration platform that combines inference, GPU compute, and private networking into a single control plane. It provides hosted inference and dedicated GPU capacity, built-in private connectivity, and observability so teams can move models from testing to production without stitching together separate vendors. The platform targets developers, enterprises, and MSPs/resellers, and plans to add storage and security layers in future releases.
🕒 3 days ago
🇺🇸 United States – Remote
💵 Estimated: $148k - $189k / year
⏰ Full Time
🟠 Senior
👷 Infrastructure Engineer
👻 Ghost score 15%
Where this job comes from
Posted on StackYak's careers page ↗, not through a job board
First seen by Remote Rocketship 3 days ago
Still open on StackYak's site. Checked 1 hour ago.

2 - 10 employees
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
StackYak is an AI infrastructure orchestration platform that combines inference, GPU compute, and private networking into a single control plane. It provides hosted inference and dedicated GPU capacity, built-in private connectivity, and observability so teams can move models from testing to production without stitching together separate vendors. The platform targets developers, enterprises, and MSPs/resellers, and plans to add storage and security layers in future releases.
• Define the GPU fleet strategy, including owned versus rented capacity, standardization, and cost • Manage Linux, kernel, firmware, drivers, CUDA and/or ROCm across GPU machines • Own the boundary between bare metal, virtual machines, and containers • Design and validate customer and workload isolation • Automate provisioning, rebuilding, and recovery of remote machines • Integrate neocloud and other compute-provider APIs and capacity • Specify hardware and coordinate its path from purchase order to booting machine through vendors, data-center partners, and remote hands • Diagnose failures spanning hardware, firmware, operating systems, virtualization, storage, networking, and workloads • Build operational tooling so others can operate the fleet • Design, build, debug, and operate production infrastructure • Help determine workload placement, machine recovery, owned versus rented capacity, standardization, platform coherence, and productized infrastructure capabilities • Participate in technical decisions and shared production/on-call responsibility
• Deep production Linux experience, including kernel-level troubleshooting • Experience operating GPU infrastructure for AI, HPC, cloud, or similarly demanding workloads • Experience with NVIDIA and/or AMD platforms, including difficult driver or firmware upgrades • Experience provisioning bare metal at scale without manual configuration • Experience managing and recovering machines that cannot be physically accessed • Experience choosing between bare metal, KVM, and containers for consequential workloads • Production experience writing Terraform and Python tooling • Experience hardening hosts and isolating customer workloads • Experience debugging failures across hardware, firmware, OS, drivers, networking, and workloads • Experience with neoclouds, hyperscalers, GPU clouds, HPC environments, hosting companies, data-center operators, or AI infrastructure companies is especially strong • Experience operating mixed owned and rented capacity is especially strong • Experience with multi-GPU and multi-node systems is especially strong • Understanding of NUMA, PCIe topology, RDMA, NIC placement, and physical topology for AI workloads is especially strong • Experience specifying or accepting hardware is especially strong • Experience designing multi-customer infrastructure is especially strong • Experience working outside tightly siloed enterprise teams is especially strong • No specific degree, certification, or academic credential required
• Meaningful equity • Employment or contract engagement depending on location • Remote and distributed work across time zones • Direct access to founders • Participation in technical decisions • Shared responsibility for production and on-call • A few real conversations with the people you would actually work with instead of a recruiter screen and panel • Competitive compensation
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🕒 6 days ago
IT Infrastructure Engineer leading Zero Trust, cloud infrastructure, and automation for Renalogic’s chronic kidney disease care platform. Fully remote role protecting PHI and supporting HIPAA and SOC 2 compliance.
🕒 November 13
Senior Systems & Infrastructure Engineer operating cloud infrastructure for Buzz Solutions’ AI-powered power-grid inspection platform. Scaling secure data pipelines, Kubernetes, observability and model-serving systems.
🕒 November 12
Full-stack engineer building AI-powered tools that simplify operating-room workflows for surgical teams. Owning reliable product, machine-learning, and infrastructure projects across Europe and US teams.
🕒 November 12
Staff Infrastructure Engineer improving cloud infrastructure, CI/CD, databases, and security for Hex’s data exploration and analytics platform. Owning foundational projects across Kubernetes and AWS.
🇺🇸 United States – Remote
💵 $214k - $285k / year
⏰ Full Time
🟡 Mid-level
🟠 Senior
👷 Infrastructure Engineer
🦅 H1B Visa Sponsor
🕒 November 11
Senior Infrastructure Engineer building Walrus’s B2B payment verification platform. Designing and owning payments, reputation, and authentication modules.