Senior Software Engineer, Agent Infrastructure

πŸ•’ October 22

πŸ’΅ $160k - $260k / year

⏰ Full Time

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

Where this job comes from

Posted on Cohere's careers page β†—Cohere's careers page, not through a job board

First seen by Remote Rocketship October 22

Still open on Cohere's site. Checked 2 hours ago.

Apply Now
Logo of Cohere

Cohere

11 - 50 employees

πŸ€– Artificial Intelligence

🏒 Enterprise

☁️ SaaS

Artificial Intelligence β€’ Enterprise β€’ SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

πŸ“‹ Description

β€’ Build the next generation of agentic AI infrastructure β€’ Develop secure execution environments for agent-generated code β€’ Design identity, authentication, and trust boundaries for agents β€’ Build model routing and orchestration across different model types and environments β€’ Implement rate limiting, quotas, and resource management for agent workflows β€’ Create state management, memory, and filesystem abstractions for agents β€’ Turn emerging ML research ideas into production-ready infrastructure β€’ Build core platform capabilities for execution, storage, and state management β€’ Prototype and evaluate new technologies and help decide what moves into production β€’ Partner with research teams to shape infrastructure for future agent systems

🎯 Requirements

β€’ Experience building production ML infrastructure with strong systems fundamentals β€’ Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks β€’ Familiarity with model routing and LLM provider frameworks across different model types and environments β€’ Experience with scalable, fault-tolerant distributed systems and Kubernetes β€’ Track record of moving quickly on prototypes and making good decisions about productionization β€’ Experience across on-prem, private cloud, and public cloud environments β€’ Familiarity with storage systems, embedded databases, or filesystem abstractions β€’ Experience with code execution sandboxes such as gVisor, Firecracker, Kata, or WASM runtimes β€’ Interest in emerging ML infrastructure, edge inference, or browser-native models β€’ Open-source contributions to LLM or agent infrastructure projects β€’ Experience with identity, workload auth, or capability-based security systems β€’ Must be authorized to work in the country currently residing in

πŸ–οΈ Benefits

β€’ A weekly lunch stipend of $75/Β£75 or equivalent in your local currency β€’ Full health and dental benefits, including a separate budget for mental health β€’ RRSP matching, 401K, Pension Scheme β€’ 100% Parental Leave top-up for up to 6 months, for either parent β€’ Annual enrichment benefits: arts & culture, fitness/wellness, quality time, and a workspace improvement credit β€’ Education & learning stipend for conferences, courses, and coaching β€’ 6 weeks of paid vacation (30 working days) β€’ Budget for traveling to other offices if you are remote β€’ Annual company offsite β€’ Daily lunch program, snacks, and regular community and social events for office-based employees β€’ Co-working benefit for employees not near an office β€’ $500 home office stipend

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 21

Davies

5001 - 10000

πŸ›‘οΈ Insurance

πŸ’Ό Consulting

Technical Lead overseeing spill response and environmental remediation for Pario, a forensic engineering and environmental consulting firm. Managing technical reviews, field work, reporting, and client projects across Atlantic Canada.

πŸ‡¨πŸ‡¦ Canada – Remote

πŸ’° $369.2M Debt Financing - Davies Group on 2025-05

⏰ Full Time

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ October 21

Grafana Labs

501 - 1000

🏒 Enterprise

☁️ SaaS

πŸ€– Artificial Intelligence

Senior Backend Software Engineer building distributed Go-based observability databases for Grafana Cloud. Owning reliability, performance, operations, and open-source contributions at Grafana Labs.

πŸ•’ October 20

Tether.to

11 - 50

β‚Ώ Crypto

πŸ’³ Fintech

πŸ’Έ Finance

Product Engineering Lead guiding API and frontend teams building Keet, Tether’s peer-to-peer messaging and video calling app. Shaping consumer features for global scale.

πŸ•’ October 19

Domino Data Lab

201 - 500

πŸ€– Artificial Intelligence

🏒 Enterprise

☁️ SaaS

Staff Software Engineer shaping Domino’s centralized identity and authorization platform. Designing scalable SpiceDB-based access controls, cloud identity integrations, and enterprise-grade security foundations.

πŸ•’ October 19

BusPlanner

51 - 200

πŸš— Transport

☁️ SaaS

πŸ“š Education

Senior Full Stack Developer modernizing school transportation platforms with C#, C++, React, and Claude Code. Building reliable core systems and cloud-native AI-enabled applications.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok