Senior Site Reliability Engineer – AI Infrastructure

Job not on LinkedIn

πŸ•’ April 9

Where this job comes from

Posted on Andromeda's careers page β†—Andromeda's careers page, not through a job board

First seen by Remote Rocketship April 9

Still open on Andromeda's site. Checked 4 hours ago.

Apply Now
Logo of Andromeda

Andromeda

11 - 50 employees

πŸ₯ Healthcare

πŸ’Ό Consulting

🏨 Hospitality

πŸ”₯ Funding within the last year

πŸ’° $15.1M Series A - Andromeda Robotics on 2025-09

Healthcare β€’ Consulting β€’ Hospitality

Andromeda is a GPU compute service and marketplace offering instant access to large clusters of H100, H200, and B200 accelerators for experiments, full-scale training, and inference. It supports orchestration with Slurm, Kubernetes, or direct SSH, provides flexible, no-minimum-duration usage and competitive pricing, and includes DevOps expertise, local NAS or streamed storage with no ingress/egress fees, and 24/7 support with industry SLAs. The company also operates a third-party GPU marketplace at gpulist. ai.

πŸ“‹ Description

β€’ Design and evolve multi-provider, multi-region GPU compute clusters optimized for large-scale training β€’ Serve as the primary technical point of contact for customers running large-scale training workloads β€’ Define SLOs and error budgets that account for the unique failure modes of GPU infrastructure β€’ Ensure the health and performance of high-speed interconnects β€’ Build deep visibility into GPU utilization, memory pressure, interconnect throughput β€’ Build production-grade automation for cluster provisioning, GPU health checks, job scheduling β€’ Lead incident response for complex failures spanning hardware, networking, orchestration

🎯 Requirements

β€’ Deep, hands-on experience operating large-scale GPU clusters (NVIDIA A100/H100/B200 or equivalent) β€’ Production experience with InfiniBand, RoCE, or NVLink fabrics in the context of distributed training β€’ Working knowledge of NCCL, CUDA, PyTorch distributed, DeepSpeed, Megatron, FSDP, or similar β€’ Expert-level Linux knowledge β€’ Strong experience running Kubernetes in production with GPU workloads β€’ Strong engineering skills in Python, Go, or Bash β€’ Hands-on experience building monitoring and alerting for GPU infrastructure β€’ Proven track record leading incident response for complex distributed systems

πŸ–οΈ Benefits

β€’ Health insurance β€’ Retirement plans β€’ Paid time off β€’ Flexible work arrangements β€’ Professional development

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ April 3

Runlayer

11 - 50

πŸ€– Artificial Intelligence

πŸ”’ Cybersecurity

☁️ SaaS

Site Reliability Engineer ensuring performance and scalability of Runlayer’s AI infrastructure. Collaborating with founders and engineers in a fast-paced environment to support cloud and on-prem setups.

πŸ•’ April 2

Nebius Group

1001 - 5000

πŸ€– Artificial Intelligence

🏒 Enterprise

☁️ SaaS

Site Reliability Engineer operating Nebius’s AI cloud infrastructure. Automating Linux systems, improving CI/CD, and ensuring reliable hardware infrastructure operations.

πŸ•’ April 1

NVision IT, LLC

11 - 50

πŸŽ–οΈ Defense

πŸ₯ Healthcare

πŸ“¦ Logistics

DevOps consultant at NVision IT supporting federal projects with technical and strategic server support. Requires U.S. citizenship and active security clearance.

πŸ•’ April 1

SPLICE

1 - 10

πŸ’Ό Consulting

🎯 Recruiter

πŸ“£ Marketing

Senior Engineer - DevOps responsible for supporting clients' software through the lifecycle. Collaborating in a hybrid environment with significant technical guidance and mentoring.

πŸ•’ March 31

Liatrio

51 - 200

🏒 Enterprise

☁️ SaaS

πŸ’Ό Consulting

Principal Architect at Liatrio, delivering technology strategy and architecture in various industries. Engage as trusted advisor managing client relationships and guiding DevOps transformations.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok