Senior/Staff Software Engineer, Back-End – Inference

πŸ•’ October 15

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ CA$290k - CA$400k / year

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

πŸ”™ Backend Engineer

Where this job comes from

Posted on Cohere's careers page β†—Cohere's careers page, not through a job board

First seen by Remote Rocketship October 15

Still open on Cohere's site. Checked 6 hours ago.

Apply Now
Logo of Cohere

Cohere

11 - 50 employees

πŸ€– Artificial Intelligence

🏒 Enterprise

☁️ SaaS

Artificial Intelligence β€’ Enterprise β€’ SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

πŸ“‹ Description

β€’ Evolve and scale the backend systems powering Model Vault, including authentication and authorization, deployment management, billing, metering, and customer lifecycle β€’ Lead architectural initiatives across identity, payments, usage systems, platform scalability, and core product foundations β€’ Build reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platforms β€’ Design APIs and distributed systems with guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observability β€’ Build security and privacy into the platform architecture through tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundaries β€’ Solve complex problems spanning backend systems, cloud infrastructure, security, and AI inference β€’ Drive projects end-to-end from architecture and threat modeling through implementation, rollout, production operations, and iteration based on customer workloads

🎯 Requirements

β€’ Strong backend engineering fundamentals in distributed systems, databases, networking, operating systems, and security β€’ Strong programming fundamentals and production experience in Go, Python, Java, C++, Rust, or similar β€’ Experience designing and operating production systems where correctness, availability, security, and performance mattered at significant scale β€’ Strong systems-design skills, including concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradation β€’ Understanding of authentication, authorization, identity, cryptography, secrets, tenant isolation, and security risks β€’ Comfort working across backend services, APIs, databases, distributed systems, and cloud infrastructure β€’ Experience debugging complex problems across service or system boundaries β€’ Production engineering experience with instrumentation, capacity planning, migrations, backward compatibility, incident response, and safe rollouts β€’ Track record of taking technically difficult projects from ambiguity to reliable production systems β€’ Ability to write clean, maintainable, well-tested code and make tradeoffs between simplicity, performance, and correctness

πŸ–οΈ Benefits

β€’ Offers equity β€’ Weekly lunch stipend of $75/Β£75 or equivalent in local currency β€’ Full health and dental benefits β€’ Separate mental health budget β€’ RRSP matching, 401K, Pension Scheme β€’ 100% parental leave top-up for up to 6 months, for either parent β€’ Annual enrichment benefits for arts and culture, fitness/wellness, quality time, and workspace improvement β€’ Education and learning stipend for conferences, courses, and coaching β€’ 6 weeks of paid vacation (30 working days) β€’ Budget for traveling to other offices if remote β€’ Annual company offsite β€’ Daily lunch program, snacks, and regular community and social events for office-based employees β€’ Co-working benefit for employees not near an office β€’ $500 home office stipend

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 14

Grafana Labs

501 - 1000

🏒 Enterprise

☁️ SaaS

πŸ€– Artificial Intelligence

Senior Backend Engineer evolving Grafana Labs’ open-source Tempo tracing backend. Improving distributed systems, APIs, scalability, performance, and operational excellence for Grafana observability products.

πŸ•’ October 14

Capgemini

10,000+ employees

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Kubernetes and HPC Engineer building scalable AI/ML and simulation infrastructure for Capgemini Engineering. Managing Kubernetes, HPC clusters, NVIDIA GPUs, automation, and cloud-native platforms.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ $72.1k - $138.9k / year

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ”™ Backend Engineer

πŸ•’ October 14

Clariti

51 - 200

πŸ›οΈ Government

🏒 Enterprise

Technical Architect leading Salesforce architecture, integrations, and data migration for Clariti, which empowers governments to deliver exceptional citizen experiences. Supporting complex implementations and delivery improvements.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ $116k - $155k / year

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ”™ Backend Engineer

πŸ•’ October 13

Affirm

1001 - 5000

πŸ’³ Fintech

πŸ‘₯ B2C

πŸ›οΈ eCommerce

Senior backend engineer building scalable lakehouse infrastructure for Affirm’s pay-over-time platform. Leading distributed data systems, reliability, technical standards, and engineering delivery.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ $153k - $213k / year

πŸ’° Post-IPO Equity on 2021-01

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ”™ Backend Engineer

πŸ•’ October 8

Warner Music Group

1001 - 5000

πŸ“± Media

Senior software engineer building backend, DevOps, and MLOps infrastructure for Sureel AI's creator-rights and licensing platform. Developing reliable AI systems for music and broader media.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’΅ $110k - $145k / year

πŸ’° Post-IPO Debt on 2021-10

⏰ Full Time

🟠 Senior

πŸ”™ Backend Engineer

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok