GPU Infrastructure Engineer

Job not on LinkedIn

🕒 5 days ago

🇨🇦 Canada – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

👷 Infrastructure Engineer

Where this job comes from

Posted on PolarGrid's careers page ↗PolarGrid's careers page, not through a job board

First seen by Remote Rocketship 5 days ago

Still open on PolarGrid's site. Checked 9 minutes ago.

Apply Now
Logo of PolarGrid

PolarGrid

2 - 10 employees

🤖 Artificial Intelligence

🔌 API

🤝 B2B

Artificial Intelligence • API • B2B

PolarGrid provides managed AI model inference on dedicated GPUs across a network of sites. Its platform lets businesses deploy custom models through a single endpoint, with traffic routing, scaling, failover, and deployment monitoring.

📋 Description

• Scale PolarGrid's inference network from a handful of sites to a geographically distributed fleet of GPU clusters • Own how new sites and nodes come online, from provisioning and burn-in through validation and staged production rollout • Define when a site is ready for customer traffic and ensure new sites join the network without harming latency or reliability • Run the global routing layer that directs requests to the best serving location • Use network latency, capacity and health signals to tune routing against live traffic • Set and track availability targets across the network • Build health checks and automation to detect and route around failing hardware and models • Keep recovery fast and regularly test failure handling • Build observability, release and network systems for operating a distributed GPU fleet at scale • Implement end-to-end tracing and latency alerting • Manage safe staged rollouts • Maintain network configuration as code • Implement security and DDoS protection at the edge

🎯 Requirements

• Experience operating distributed systems across multiple sites or regions with high availability targets • Strong networking fundamentals: BGP, DNS, TCP/TLS and load balancing • Hands-on experience running bare-metal GPU fleets: provisioning, burn-in, firmware and node lifecycle • InfiniBand or RDMA networking experience • Experience running LLM inference engines such as vLLM, SGLang or TensorRT-LLM, including multi-node serving, cold starts and TTFT • Deep observability skills focused on p95/p99 latency and gray failures, not just uptime • Experience designing failover, graceful degradation and automated recovery • Strong automation and infrastructure-as-code mindset, including CI/CD for infrastructure • Ability to plan capacity on constrained, uneven hardware supply • Experience building internal tooling or control planes, ideally in Go or Rust • DDoS mitigation experience • Running DNS infrastructure at scale • Hardware security: TPM, measured boot or confidential computing • Real-time streaming inference, including voice and audio • Operating remote datacenter sites with on-site technicians • Certificate automation across many domains • Deterministic simulation testing

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 November 14

DataVisor

51 - 200

💸 Finance

💳 Fintech

☁️ SaaS

Senior Infrastructure Engineer scaling AWS Kubernetes, streaming, and data infrastructure for DataVisor’s AI-powered fraud and risk platform. Building reliable platform software and real-time detection systems.

🇨🇦 Canada – Remote

💵 $120k - $150k / year

💰 Series C on 2019-10

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷 Infrastructure Engineer

🕒 November 10

Cohere

11 - 50

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Adoption Specialist scaling Cohere’s enterprise AI solutions through infrastructure and agentic partner certifications. Building developer training for secure private-cloud deployments and LLM-powered workflows.

🕒 November 9

StackAdapt

1001 - 5000

📣 Marketing

☁️ SaaS

📱 Media

Staff Infrastructure Engineer optimizing cloud infrastructure costs for StackAdapt’s AI-powered programmatic advertising platform. Building cost models, forecasting systems, and tooling for engineering and finance decisions.

🇨🇦 Canada – Remote

💵 $182.4k - $250.8k / year

💰 $235M Private Equity Round - StackAdapt on 2025-02

⏰ Full Time

🟠 Senior

🔴 Lead

👷 Infrastructure Engineer

🕒 November 6

Ashby

51 - 200

💼 Consulting

🤝 B2B

👥 HR Tech

Head of Platform & Infrastructure Engineering leading reliability, infrastructure, and team growth at Ashby, a talent acquisition software company. Driving scalable performance, hiring, and vendor strategy.

🕒 November 3

Fullscript

201 - 500

🏥 Healthcare

📦 Logistics

🏭 Manufacturing

Engineering Manager leading Ruby on Rails backend infrastructure for Fullscript’s healthcare technology platform. Improving developer productivity, application reliability, and technical standards across teams.

🇨🇦 Canada – Remote

💰 $240M Private Equity Round on 2021-11

⏰ Full Time

🟠 Senior

🔴 Lead

👷 Infrastructure Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok