Senior GPU Infrastructure Engineer, Deployment

Job not on LinkedIn

πŸ•’ 3 days ago

πŸ‡¨πŸ‡¦ Canada – Remote

⏰ Full Time

🟠 Senior

β›‘ DevOps & Site Reliability Engineer (SRE)

Where this job comes from

Posted on PolarGrid's careers page β†—PolarGrid's careers page, not through a job board

First seen by Remote Rocketship 3 days ago

Still open on PolarGrid's site. Checked 55 minutes ago.

Apply Now
Logo of PolarGrid

PolarGrid

2 - 10 employees

πŸ€– Artificial Intelligence

πŸ”Œ API

🀝 B2B

Artificial Intelligence β€’ API β€’ B2B

PolarGrid provides managed AI model inference on dedicated GPUs across a network of sites. Its platform lets businesses deploy custom models through a single endpoint, with traffic routing, scaling, failover, and deployment monitoring.

πŸ“‹ Description

β€’ Own the process of bringing new GPU servers from datacenter racks to tested, production-ready customer nodes β€’ Define node readiness criteria β€’ Build automation to provision and prepare GPU servers β€’ Maintain fleet health after servers enter service β€’ Provision, rigorously test, and validate large GPU servers before customer use β€’ Wipe servers clean between customers β€’ Detect failing hardware early and remove it from service β€’ Standardize server deployment and maintenance across multiple datacenter sites β€’ Work with datacenter partners and on-site staff β€’ Collaborate closely with routing and network engineers β€’ Participate in on-call support for the GPU fleet

🎯 Requirements

β€’ Experience bringing up multi-GPU servers or clusters for production workloads, including acceptance testing and burn-in β€’ Experience with high-speed GPU networking such as InfiniBand or RoCE β€’ Experience automating bare-metal provisioning and maintaining consistent firmware and images across a fleet β€’ Ability to diagnose GPU and server hardware faults and decide when to repair or replace β€’ Experience running GPUs inside virtual machines or otherwise isolating customers on shared hardware β€’ Experience working with remote datacenter staff and being on call for a fleet β€’ Ability to write scripts and tools in Python, Go, Bash, or a similar language β€’ Ability to use AI tools effectively and check their work β€’ Real-world experience putting GPU hardware into service for other people's workloads and keeping it running

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ November 12

Revvity

10,000+ employees

πŸ₯ Healthcare

πŸ’Ό Consulting

πŸ“¦ Logistics

Principal DevOps Engineer building scalable AI/ML infrastructure for Revvity Signals’ scientific research software. Owning cloud platforms, Kubernetes, model CI/CD, and production reliability.

πŸ•’ November 11

Caseware

201 - 500

πŸ’Έ Finance

🏒 Enterprise

☁️ SaaS

Staff SRE building reliable AWS and Kubernetes infrastructure for Caseware’s AI-powered audit and accounting software. Driving observability, secure delivery, incident response, and platform resilience.

πŸ•’ November 6

Upgrade, Inc.

1001 - 5000

πŸ’Ό Consulting

πŸ›‘οΈ Insurance

πŸ“‹ Compliance

Principal DevSecOps Developer building security automation and cloud controls for Upgrade, a fintech company delivering responsible consumer financial products. Improving security operations across AWS and enterprise systems.

πŸ•’ November 5

Modaxo

1001 - 5000

πŸš— Transport

☁️ SaaS

🀝 B2B

Site reliability specialist building cloud landing zones, Kubernetes, CI/CD, and observability. Establishing reliability practices for customers running 24/7 mission-critical operations.

πŸ•’ November 3

ClickHouse

51 - 200

☁️ SaaS

🏒 Enterprise

πŸ€– Artificial Intelligence

Senior Site Reliability Engineer improving ClickHouse Cloud reliability, scalability, and incident response. Building automation and distributed systems for ClickHouse’s cloud database platform.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok