Senior Software Engineer, Agent Infrastructure

🔥 1 minute ago

🌐 Canada, United States – Remote

🇨🇦 Canada – Remote 🇺🇸 United States – Remote

💵 $160k - $260k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

👻 Ghost score 21%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Cohere

WebsiteLinkedInAll Job Openings

11 - 50 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Artificial Intelligence • Enterprise • SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

📋 Description

• Build the next generation of agentic AI infrastructure • Develop secure execution environments for agent-generated code • Design identity, authentication, and trust boundaries for agents • Build model routing and orchestration across different model types and environments • Implement rate limiting, quotas, and resource management for agent workflows • Create state management, memory, and filesystem abstractions for agents • Turn emerging ML research ideas into production-ready infrastructure • Build core platform capabilities for execution, storage, and state management • Prototype and evaluate new technologies and help decide what moves into production • Partner with research teams to shape infrastructure for future agent systems

🎯 Requirements

• Experience building production ML infrastructure with strong systems fundamentals • Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks • Familiarity with model routing and LLM provider frameworks across different model types and environments • Experience with scalable, fault-tolerant distributed systems and Kubernetes • Track record of moving quickly on prototypes and making good decisions about productionization • Experience across on-prem, private cloud, and public cloud environments • Familiarity with storage systems, embedded databases, or filesystem abstractions • Experience with code execution sandboxes such as gVisor, Firecracker, Kata, or WASM runtimes • Interest in emerging ML infrastructure, edge inference, or browser-native models • Open-source contributions to LLM or agent infrastructure projects • Experience with identity, workload auth, or capability-based security systems • Must be authorized to work in the country currently residing in

🏖️ Benefits

• A weekly lunch stipend of $75/£75 or equivalent in your local currency • Full health and dental benefits, including a separate budget for mental health • RRSP matching, 401K, Pension Scheme • 100% Parental Leave top-up for up to 6 months, for either parent • Annual enrichment benefits: arts & culture, fitness/wellness, quality time, and a workspace improvement credit • Education & learning stipend for conferences, courses, and coaching • 6 weeks of paid vacation (30 working days) • Budget for traveling to other offices if you are remote • Annual company offsite • Daily lunch program, snacks, and regular community and social events for office-based employees • Co-working benefit for employees not near an office • $500 home office stipend