Senior/Staff Software Engineer, Back-End – Inference

🕒 October 15

🇨🇦 Canada – Remote

💵 CA$290k - CA$400k / year

⏰ Full Time

🟠 Senior

🔙 Backend Engineer

👻 Ghost score 21%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Cohere

WebsiteLinkedInAll Job Openings

11 - 50 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Artificial Intelligence • Enterprise • SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

📋 Description

• Evolve and scale the backend systems powering Model Vault, including authentication and authorization, deployment management, billing, metering, and customer lifecycle • Lead architectural initiatives across identity, payments, usage systems, platform scalability, and core product foundations • Build reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platforms • Design APIs and distributed systems with guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observability • Build security and privacy into the platform architecture through tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundaries • Solve complex problems spanning backend systems, cloud infrastructure, security, and AI inference • Drive projects end-to-end from architecture and threat modeling through implementation, rollout, production operations, and iteration based on customer workloads

🎯 Requirements

• Strong backend engineering fundamentals in distributed systems, databases, networking, operating systems, and security • Strong programming fundamentals and production experience in Go, Python, Java, C++, Rust, or similar • Experience designing and operating production systems where correctness, availability, security, and performance mattered at significant scale • Strong systems-design skills, including concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradation • Understanding of authentication, authorization, identity, cryptography, secrets, tenant isolation, and security risks • Comfort working across backend services, APIs, databases, distributed systems, and cloud infrastructure • Experience debugging complex problems across service or system boundaries • Production engineering experience with instrumentation, capacity planning, migrations, backward compatibility, incident response, and safe rollouts • Track record of taking technically difficult projects from ambiguity to reliable production systems • Ability to write clean, maintainable, well-tested code and make tradeoffs between simplicity, performance, and correctness

🏖️ Benefits

• Offers equity • Weekly lunch stipend of $75/£75 or equivalent in local currency • Full health and dental benefits • Separate mental health budget • RRSP matching, 401K, Pension Scheme • 100% parental leave top-up for up to 6 months, for either parent • Annual enrichment benefits for arts and culture, fitness/wellness, quality time, and workspace improvement • Education and learning stipend for conferences, courses, and coaching • 6 weeks of paid vacation (30 working days) • Budget for traveling to other offices if remote • Annual company offsite • Daily lunch program, snacks, and regular community and social events for office-based employees • Co-working benefit for employees not near an office • $500 home office stipend

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume