Staff Software Engineer, Inference Routing

Job not on LinkedIn

πŸ•’ 3 days ago

πŸ‡¨πŸ‡¦ Canada – Remote

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

πŸ§‘β€πŸ’» Full-stack Engineer

Where this job comes from

Posted on PolarGrid's careers page β†—PolarGrid's careers page, not through a job board

First seen by Remote Rocketship 3 days ago

Still open on PolarGrid's site. Checked 1 hour ago.

Apply Now
Logo of PolarGrid

PolarGrid

2 - 10 employees

πŸ€– Artificial Intelligence

πŸ”Œ API

🀝 B2B

Artificial Intelligence β€’ API β€’ B2B

PolarGrid provides managed AI model inference on dedicated GPUs across a network of sites. Its platform lets businesses deploy custom models through a single endpoint, with traffic routing, scaling, failover, and deployment monitoring.

πŸ“‹ Description

β€’ Own the routing layer that decides which GPU serves each request β€’ Design and write the router and placement logic β€’ Build, operate, and set the technical direction of the routing system in production β€’ Ensure requests are routed to healthy, available, and sufficiently nearby GPUs β€’ Handle changing capacity and health across multiple sites β€’ Implement safe failure handling so traffic moves transparently when sites or servers go down β€’ Work closely with engineers operating the network and GPU sites β€’ Help hire engineers for the team

🎯 Requirements

β€’ Deep knowledge of how networks, proxies and load balancers work underneath, from building or running production systems β€’ Strong distributed systems fundamentals: consistency, failure handling, retries and backpressure β€’ Production coding experience in a systems language such as Go or Rust β€’ Experience measuring tail latency and identifying its causes β€’ Experience being on call for systems built β€’ Experience setting technical direction that other engineers built on β€’ Clear writing β€’ Effective use of AI tools and ability to check their work β€’ GPU or ML experience is not required

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ 3 days ago

StackAdapt

1001 - 5000

πŸ“£ Marketing

☁️ SaaS

πŸ“± Media

Staff Software Engineer shaping high-throughput distributed systems for StackAdapt’s programmatic advertising platform. Leading inventory integrations, performance optimization, and technical direction.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ $182.4k - $250.8k / year

πŸ’° $235M Private Equity Round - StackAdapt on 2025-02

⏰ Full Time

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ 3 days ago

StackAdapt

1001 - 5000

πŸ“£ Marketing

☁️ SaaS

πŸ“± Media

Software Engineer building scalable identity-resolution and backend systems for StackAdapt’s AI-powered advertising platform. Processing high-volume identity data for real-time targeting, audience segmentation, and measurement.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ $140k - $192.5k / year

πŸ’° $235M Private Equity Round - StackAdapt on 2025-02

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ 3 days ago

Ciena

5001 - 10000

πŸ“‘ Telecommunications

πŸ”§ Hardware

SME Product Engineer owning modem product engineering and service support strategy. Improving repair solutions, NPI enablement, and lifecycle operations for Ciena networking infrastructure.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ $68k - $108.6k / year

πŸ’° Series C on 1995-12

⏰ Full Time

πŸ”΄ Lead

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ 3 days ago

Tanium

1001 - 5000

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Senior Software Engineer building cloud-based data services for Tanium’s autonomous IT platform. Developing backend systems with PostgreSQL, cloud storage, APIs, and Kubernetes.

πŸ•’ 3 days ago

TLNT Bridge Recruiting

2 - 10

🎯 Recruiter

🀝 B2B

Staff Software Developer building scalable web and mobile solutions for a building supply technology platform. Leading architecture, integrations, AI-enabled development, and engineering excellence.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok