GPU Infrastructure Engineer

Job not on LinkedIn

🔥 25 minutes ago

🇨🇦 Canada – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

Where this job comes from

Posted on PolarGrid's careers page ↗PolarGrid's careers page, not through a job board

First seen by Remote Rocketship 25 minutes ago

Still open on PolarGrid's site. Checked 19 minutes ago.

Apply Now
Logo of PolarGrid

PolarGrid

2 - 10 employees

🤖 Artificial Intelligence

🔌 API

🤝 B2B

Artificial Intelligence • API • B2B

PolarGrid provides managed AI model inference on dedicated GPUs across a network of sites. Its platform lets businesses deploy custom models through a single endpoint, with traffic routing, scaling, failover, and deployment monitoring.

📋 Description

• Scale PolarGrid's inference network from a handful of sites to a geographically distributed fleet of GPU clusters • Own how new sites and nodes come online, from provisioning and burn-in through validation and staged production rollout • Define when a site is ready for customer traffic and ensure new sites join the network without harming latency or reliability • Run the global routing layer that directs requests to the best serving location • Use network latency, capacity and health signals to tune routing against live traffic • Set and track availability targets across the network • Build health checks and automation to detect and route around failing hardware and models • Keep recovery fast and regularly test failure handling • Build observability, release and network systems for operating a distributed GPU fleet at scale • Implement end-to-end tracing and latency alerting • Manage safe staged rollouts • Maintain network configuration as code • Implement security and DDoS protection at the edge

🎯 Requirements

• Experience operating distributed systems across multiple sites or regions with high availability targets • Strong networking fundamentals: BGP, DNS, TCP/TLS and load balancing • Hands-on experience running bare-metal GPU fleets: provisioning, burn-in, firmware and node lifecycle • InfiniBand or RDMA networking experience • Experience running LLM inference engines such as vLLM, SGLang or TensorRT-LLM, including multi-node serving, cold starts and TTFT • Deep observability skills focused on p95/p99 latency and gray failures, not just uptime • Experience designing failover, graceful degradation and automated recovery • Strong automation and infrastructure-as-code mindset, including CI/CD for infrastructure • Ability to plan capacity on constrained, uneven hardware supply • Experience building internal tooling or control planes, ideally in Go or Rust • DDoS mitigation experience • Running DNS infrastructure at scale • Hardware security: TPM, measured boot or confidential computing • Real-time streaming inference, including voice and audio • Operating remote datacenter sites with on-site technicians • Certificate automation across many domains • Deterministic simulation testing

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 2 days ago

DataVisor

51 - 200

💸 Finance

💳 Fintech

☁️ SaaS

Senior Infrastructure Engineer scaling AWS Kubernetes, streaming, and data infrastructure for DataVisor’s AI-powered fraud and risk platform. Building reliable platform software and real-time detection systems.

🇨🇦 Canada – Remote

💵 $120k - $150k / year

💰 Series C on 2019-10

⏰ Full Time

🟠 Senior

👷 Infrastructure Engineer

🕒 6 days ago

Cohere

11 - 50

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Adoption Specialist scaling Cohere’s enterprise AI solutions through infrastructure and agentic partner certifications. Building developer training for secure private-cloud deployments and LLM-powered workflows.

🇨🇦 Canada – Remote

💵 CA$290k - CA$330k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

🕒 November 3

Fullscript

201 - 500

🏥 Healthcare

📦 Logistics

🏭 Manufacturing

Engineering Manager leading Ruby on Rails backend infrastructure for Fullscript’s healthcare technology platform. Improving developer productivity, application reliability, and technical standards across teams.

🇨🇦 Canada – Remote

💰 $240M Private Equity Round on 2021-11

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

🕒 October 23

Seeq Corporation

51 - 200

🤖 Artificial Intelligence

🏭 Manufacturing

Senior Frontend Infrastructure Engineer evolving React infrastructure, design systems, and reusable patterns. Building foundations for Seeq’s industrial process data insight software.

🕒 August 27

Nexxa.ai

11 - 50

🏗️ Construction

🏭 Manufacturing

📦 Logistics

Security and Infrastructure Engineer securing Nexxa’s AI systems for heavy industries. Owning cloud infrastructure, security operations, and SOC 2/ISO 27001 compliance.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok