Member of Technical Staff, North Modelling – Evals

🕒 August 19

🏢🏡 London – Hybrid

⏰ Full Time

🟠 Senior

🔴 Lead

🖥 Software Engineer

Where this job comes from

Posted on Cohere's careers page ↗Cohere's careers page, not through a job board

First seen by Remote Rocketship August 19

Still open on Cohere's site. Checked 2 hours ago.

Apply Now
Logo of Cohere

Cohere

WebsiteLinkedIn

11 - 50 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Artificial Intelligence • Enterprise • SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

📋 Description

• Define and own the evaluation strategy for North across agent workflows, tool use, enterprise knowledge work, deep research, document creation and editing, and other human-AI interactions • Build high-quality evaluations from user feedback, production failures, privacy-preserving usage logs, internal dogfooding, customer needs, and product goals • Create systems that continuously turn learning from users, customers, and feature teams into evaluations • Extract insights from evaluation results, customer-derived data, and product context • Translate model failures, capability gaps, and North-specific needs into actionable recommendations for central modelling teams • Collaborate with North product teams, customer-facing teams, and modelling teams

🎯 Requirements

• Experience improving LLM-powered, agent-powered, or AI-product systems through evals, feedback loops, data curation, prompting, model adaptation, or model selection • Deep understanding of evaluation craft, including representative tasks, precise rubrics, clean data, failure analysis, regression tracking, and detecting false confidence in metrics • Strong applied MLE judgment • Ability to reason about model behavior, eval validity, product outcomes, and production tradeoffs • Comfort working closely with users and product teams • Ability to translate qualitative signals into actionable measurement for modelling teams • Self-directed and practical approach to open-ended problems • Technical depth and product understanding • Ability to collaborate effectively within Europe and East Coast North America time zones

🏖️ Benefits

• A weekly lunch stipend of $75/£75 or equivalent in your local currency • Full health and dental benefits, including a separate budget for mental health • RRSP matching, 401K, Pension Scheme • 100% Parental Leave top-up for up to 6 months, for either parent • Annual enrichment benefits covering arts & culture, fitness/wellness, quality time, and a workspace improvement credit • Education & learning stipend for conferences, courses, and coaching • 6 weeks of paid vacation (30 working days) • Budget for traveling to other offices if remote • Annual company offsite • Daily lunch program, snacks, and regular community and social events for office-based employees • Co-working benefit for employees not near an office • $500 home office stipend

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 August 14

Vantage Data Centers

1001 - 5000

💼 Consulting

📦 Logistics

🏭 Manufacturing

WebsiteLinkedIn

Global commissioning program developer scaling Vantage Data Centers’ mission-critical infrastructure delivery. Building standards, digital workflows, automated validation, and reporting across regions.

Assembly

🕒 August 5

CFC

501 - 1000

💼 Consulting

🏥 Healthcare

📦 Logistics

WebsiteLinkedIn

Senior Product Developer creating and enhancing commercial insurance products for CFC. Drafting complex policy wordings and coordinating product initiatives with Underwriting, Claims, and systems teams.

🕒 July 29

Bite

2 - 10

🤖 Artificial Intelligence

🏗️ Construction

☁️ SaaS

WebsiteLinkedIn

Founding Engineer at Bite working full stack on structural engineering knowledge graph. Collaborate directly with founders and manage all phases from design to deployment.

🏢🏡 London – Hybrid

⏰ Full Time

🟡 Mid-level

🟠 Senior

🖥 Software Engineer

🕒 July 28

TradingHub

51 - 200

💳 Fintech

📋 Compliance

☁️ SaaS

WebsiteLinkedIn

Senior Quantitative Developer at TradingHub developing financial pricing models and risk algorithms. In charge of building and validating pricing libraries for multiple asset classes while supporting junior team members.

🏢🏡 London – Hybrid

💰 Series unknown on 2023-07

⏰ Full Time

🟠 Senior

🖥 Software Engineer

🕒 July 28

VOLTA

51 - 200

📱 Media

📣 Marketing

🤝 B2B

WebsiteLinkedIn

Head of Project Engineering leading technical oversight for data centre build-outs at Volta. Managing multi-disciplinary engineering teams and setting fleet-wide standards for project delivery.

🏢🏡 London – Hybrid

💵 £200k - £225k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🖥 Software Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok