
2 - 10 employees
🤖 Artificial Intelligence
🔌 API
🤝 B2B
Artificial Intelligence • API • B2B
PolarGrid provides managed AI model inference on dedicated GPUs across a network of sites. Its platform lets businesses deploy custom models through a single endpoint, with traffic routing, scaling, failover, and deployment monitoring.
🔥 25 minutes ago
Where this job comes from
Posted on PolarGrid's careers page ↗, not through a job board
First seen by Remote Rocketship 25 minutes ago
Still open on PolarGrid's site. Checked 19 minutes ago.

2 - 10 employees
🤖 Artificial Intelligence
🔌 API
🤝 B2B
Artificial Intelligence • API • B2B
PolarGrid provides managed AI model inference on dedicated GPUs across a network of sites. Its platform lets businesses deploy custom models through a single endpoint, with traffic routing, scaling, failover, and deployment monitoring.
• Scale PolarGrid's inference network from a handful of sites to a geographically distributed fleet of GPU clusters • Own how new sites and nodes come online, from provisioning and burn-in through validation and staged production rollout • Define when a site is ready for customer traffic and ensure new sites join the network without harming latency or reliability • Run the global routing layer that directs requests to the best serving location • Use network latency, capacity and health signals to tune routing against live traffic • Set and track availability targets across the network • Build health checks and automation to detect and route around failing hardware and models • Keep recovery fast and regularly test failure handling • Build observability, release and network systems for operating a distributed GPU fleet at scale • Implement end-to-end tracing and latency alerting • Manage safe staged rollouts • Maintain network configuration as code • Implement security and DDoS protection at the edge
• Experience operating distributed systems across multiple sites or regions with high availability targets • Strong networking fundamentals: BGP, DNS, TCP/TLS and load balancing • Hands-on experience running bare-metal GPU fleets: provisioning, burn-in, firmware and node lifecycle • InfiniBand or RDMA networking experience • Experience running LLM inference engines such as vLLM, SGLang or TensorRT-LLM, including multi-node serving, cold starts and TTFT • Deep observability skills focused on p95/p99 latency and gray failures, not just uptime • Experience designing failover, graceful degradation and automated recovery • Strong automation and infrastructure-as-code mindset, including CI/CD for infrastructure • Ability to plan capacity on constrained, uneven hardware supply • Experience building internal tooling or control planes, ideally in Go or Rust • DDoS mitigation experience • Running DNS infrastructure at scale • Hardware security: TPM, measured boot or confidential computing • Real-time streaming inference, including voice and audio • Operating remote datacenter sites with on-site technicians • Certificate automation across many domains • Deterministic simulation testing
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🕒 2 days ago
Senior Infrastructure Engineer scaling AWS Kubernetes, streaming, and data infrastructure for DataVisor’s AI-powered fraud and risk platform. Building reliable platform software and real-time detection systems.
🇨🇦 Canada – Remote
💵 $120k - $150k / year
💰 Series C on 2019-10
⏰ Full Time
🟠 Senior
👷 Infrastructure Engineer
🕒 6 days ago
Adoption Specialist scaling Cohere’s enterprise AI solutions through infrastructure and agentic partner certifications. Building developer training for secure private-cloud deployments and LLM-powered workflows.
🕒 November 3
Engineering Manager leading Ruby on Rails backend infrastructure for Fullscript’s healthcare technology platform. Improving developer productivity, application reliability, and technical standards across teams.
🇨🇦 Canada – Remote
💰 $240M Private Equity Round on 2021-11
⏰ Full Time
🟡 Mid-level
🟠 Senior
👷 Infrastructure Engineer
🕒 October 23
Senior Frontend Infrastructure Engineer evolving React infrastructure, design systems, and reusable patterns. Building foundations for Seeq’s industrial process data insight software.
🕒 August 27
Security and Infrastructure Engineer securing Nexxa’s AI systems for heavy industries. Owning cloud infrastructure, security operations, and SOC 2/ISO 27001 compliance.