Software Engineer – AI Evaluation

🕒 October 12

🇬🇧 United Kingdom – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

Where this job comes from

Posted on Board Intelligence's careers page, not through a job board

First seen by Remote Rocketship October 12

Still open on Board Intelligence's site. Checked 2 hours ago.

Logo of Board Intelligence

Board Intelligence

51 - 200 employees

Founded 2002

☁️ SaaS

🏢 Enterprise

🤝 B2B

💰 Private equity on 2024-09

SaaS • Enterprise • B2B

Board Intelligence is a London-based company (founded 2008) that provides an AI-powered board management platform and advisory services to governance teams, company secretaries, executives, and board directors. Its SaaS products include a secure board portal, agenda planning, report-writing tools, AI minute-writing, meeting preparation, and board evaluation and development services; the company emphasizes security and the science of board effectiveness. Board Intelligence serves professional services, financial services and large enterprises, and cites clients across the FTSE 100, Fortune 500 and OMX 30 (trusted by 30% of the FTSE 100 and 80,000+ leaders).

📋 Description

• Design and build the AI evaluation suite used to measure and improve AI output quality • Build across the full stack, including data pipelines, backend services and front-end tools • Work with prompt engineers and subject matter experts to turn knowledge into tests, metrics and tooling • Help define AI quality measurement practices • Automate evaluation processes and results within the software development lifecycle • Contribute over time to AI-powered products • Deliver an evaluation suite used by engineering teams after three months • Extend evaluations across all AI products and integrate them into the SDLC after six months • Establish evaluation as a standard part of AI delivery and become a trusted voice on AI quality after twelve months

🎯 Requirements

• Upper mid-level to senior professional software engineering experience • Experience building AI powered products or tooling • Full-stack experience across front end and back end • Comfortable working independently and in ambiguity, setting own direction • Experience collaborating with non-engineers and turning their expertise into working software • Strong focus on quality, testing and attention to detail • Experience using AI coding tools in day-to-day work • Fluent written and spoken English • Nice to have: experience building evaluation suites for AI products • Nice to have: experience with Python and TypeScript • Nice to have: experience building internal tools, testing frameworks or data pipelines • Nice to have: experience at a startup or in a small team building things end to end

🏖️ Benefits

• Pension scheme • Personal performance bonus • 26 days holiday each calendar year • Bupa health & dental cover • Group life assurance • EAP • Cycle to work scheme • Diversity, equity and inclusion • Reasonable adjustments accommodated during the hiring process

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 9

Kinaxis

1001 - 5000

💼 Consulting

🏥 Healthcare

🏭 Manufacturing

Architecting agentic AI, semantic, and knowledge-graph platforms for Kinaxis’s supply-chain orchestration software. Connecting planning data with enterprise systems and enabling reusable AI capabilities.

🇬🇧 United Kingdom – Remote

💰 $33M Venture Round on 2000-05

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 October 7

ElevenLabs

1 - 10

🤖 Artificial Intelligence

📱 Media

Applied AI Engineer building reliable, measurable agents for ElevenLabs’ AI platforms. Forward-deployed with growth teams to ship production LLM systems.

🇬🇧 United Kingdom – Remote

💰 $19M Series A on 2023-06

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 September 22

Runware

11 - 50

🤖 Artificial Intelligence

🔌 API

📱 Media

Creative Engineer exploring generative image and video models for Runware. Building ComfyUI workflows, demos, and technical content for developers and creators.

🇬🇧 United Kingdom – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 September 17

Paddle

201 - 500

☁️ SaaS

💳 Fintech

🤝 B2B

Senior AI Engineer building production AI systems for Paddle, a Merchant of Record for digital product companies. Automating GTM workflows across segmentation, account research and sales operations.

🕒 September 11

Mapbox

501 - 1000

🚘 Automotive

📦 Logistics

✈️ Travel

Senior AI Engineer building evaluation-driven LLM systems, data pipelines, and agent tooling for Mapbox's real-time location platform. Owning production AI quality, latency, and reliability across teams.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok