Site Reliability Engineer, Provider Operations

🔥 14 hours ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

⛑ DevOps & Site Reliability Engineer (SRE)

👻 Ghost score 13%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

OpenRouter

WebsiteLinkedInAll Job Openings

1 - 10 employees

Founded 2023

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Consulting • Marketing • Artificial Intelligence

OpenRouter is a platform providing a unified interface for interacting with various large language models (LLMs). It focuses on delivering better prices and uptime without the need for subscriptions. The platform supports multiple AI tasks and showcases models like Mistral Small 3 and DeepSeek R1 Distill Qwen 32B, which are designed for fast performance and high accuracy. OpenRouter also features gaming and coding tools that enhance usability across different sectors such as marketing, finance, and education.

📋 Description

• Build and own monitoring for every provider and endpoint, covering latency, throughput, error rates, uptime, and output correctness • Set SLOs per provider tier and create actionable alerts • Improve detection of degraded endpoints and coordinate automatic traffic failover with the routing team • Own on-call for provider incidents, including triage, mitigation, provider communication, postmortems, and follow-up closure • Create provider scorecards and SLO reporting • Serve as the technical escalation point for misbehaving provider endpoints • Build continuous canaries and evaluations to detect silent quality regressions • Automate provider-operations tasks such as disabling endpoints, capacity changes, deprecations, and rate-limit tuning • Build endpoint load-testing tools for launch readiness and day-zero traffic • Report to the Provider Operations Manager

🎯 Requirements

• 4+ years in SRE, production engineering, or infrastructure roles running high-traffic, customer-facing systems • Strong observability practice with metrics, tracing, logs, SLOs/error budgets, and actionable alerting • Capable software engineer who prefers writing tools over executing runbooks • Experience with TypeScript and/or Python • Experience with distributed systems failure modes including timeouts, retries, backpressure, and partial outages • Ability to serve as a calm, clear incident commander and communicate with external partners under pressure • Understanding of, or eagerness to learn, LLM inference concepts including streaming, tool calling, prompt caching, throughput/latency tradeoffs, and provider API differences • Experience at an inference provider, model lab, GPU cloud, or API gateway/CDN company is nice to have • Experience with TypeScript, Cloudflare Workers, Postgres, ClickHouse, GCP, or Vercel is nice to have • Background in routing, load balancing, or traffic management systems is nice to have • Experience with evals or synthetic monitoring for ML systems is nice to have