Senior Site Reliability Engineer – AI Infrastructure

Job not on LinkedIn

🕒 April 9

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Andromeda

Andromeda

11 - 50 employees

🤖 Artificial Intelligence

🤝 B2B

🔧 Hardware

🔥 Funding within the last year

💰 $15.1M Series A - Andromeda Robotics on 2025-09

Artificial Intelligence • B2B • Hardware

Andromeda is a GPU compute service and marketplace offering instant access to large clusters of H100, H200, and B200 accelerators for experiments, full-scale training, and inference. It supports orchestration with Slurm, Kubernetes, or direct SSH, provides flexible, no-minimum-duration usage and competitive pricing, and includes DevOps expertise, local NAS or streamed storage with no ingress/egress fees, and 24/7 support with industry SLAs. The company also operates a third-party GPU marketplace at gpulist. ai.

📋 Description

• Design and evolve multi-provider, multi-region GPU compute clusters optimized for large-scale training • Serve as the primary technical point of contact for customers running large-scale training workloads • Define SLOs and error budgets that account for the unique failure modes of GPU infrastructure • Ensure the health and performance of high-speed interconnects • Build deep visibility into GPU utilization, memory pressure, interconnect throughput • Build production-grade automation for cluster provisioning, GPU health checks, job scheduling • Lead incident response for complex failures spanning hardware, networking, orchestration

🎯 Requirements

• Deep, hands-on experience operating large-scale GPU clusters (NVIDIA A100/H100/B200 or equivalent) • Production experience with InfiniBand, RoCE, or NVLink fabrics in the context of distributed training • Working knowledge of NCCL, CUDA, PyTorch distributed, DeepSpeed, Megatron, FSDP, or similar • Expert-level Linux knowledge • Strong experience running Kubernetes in production with GPU workloads • Strong engineering skills in Python, Go, or Bash • Hands-on experience building monitoring and alerting for GPU infrastructure • Proven track record leading incident response for complex distributed systems

🏖️ Benefits

• Health insurance • Retirement plans • Paid time off • Flexible work arrangements • Professional development

Apply Now

Similar Jobs

🕒 April 9

PostHog

11 - 50

☁️ SaaS

⚡ Productivity

🏢 Enterprise

SRE role focusing on turning fast-growing systems into predictable, reliable platforms. Join PostHog to build and automate infrastructure.

🕒 April 9

Cresta

51 - 200

☁️ SaaS

🤖 Artificial Intelligence

🏢 Enterprise

Senior Infrastructure Engineer/SRE responsible for building core infrastructure at AI-driven contact center company. Designing tools for developers and ensuring reliability across cloud platforms.

🕒 April 8

EITACIES Inc.

51 - 200

🏢 Enterprise

🔒 Cybersecurity

🤖 Artificial Intelligence

DevOps Architect leading platform engineering standards across a multi-cloud, hybrid environment at Eitacies Inc. Focus on automation, infrastructure, and cloud architecture.

🕒 April 8

Flywire

1001 - 5000

💸 Finance

💳 Fintech

Manager II, Site Reliability Engineering at Flywire driving reliability and performance in our cloud infrastructure. Lead SRE teams, collaborate across functions, and ensure production excellence.

🕒 April 7

LMI

1001 - 5000

🤖 Artificial Intelligence

⚕️ Healthcare Insurance

🏛️ Government

Senior DevSecOps / Platform Engineer building and supporting AWS infrastructure for Navy logistics. Work closely with developers to ensure stability, security, and speed.