Software Engineer – AI Evaluation

πŸ•’ October 12

πŸ‡¬πŸ‡§ United Kingdom – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ€– AI Engineer

Where this job comes from

Posted on Board Intelligence's careers page β†—Board Intelligence's careers page, not through a job board

First seen by Remote Rocketship October 12

Still open on Board Intelligence's site. Checked 3 hours ago.

Apply Now
Logo of Board Intelligence

Board Intelligence

51 - 200 employees

Founded 2002

☁️ SaaS

🏒 Enterprise

🀝 B2B

πŸ’° Private equity on 2024-09

SaaS β€’ Enterprise β€’ B2B

Board Intelligence is a London-based company (founded 2008) that provides an AI-powered board management platform and advisory services to governance teams, company secretaries, executives, and board directors. Its SaaS products include a secure board portal, agenda planning, report-writing tools, AI minute-writing, meeting preparation, and board evaluation and development services; the company emphasizes security and the science of board effectiveness. Board Intelligence serves professional services, financial services and large enterprises, and cites clients across the FTSE 100, Fortune 500 and OMX 30 (trusted by 30% of the FTSE 100 and 80,000+ leaders).

πŸ“‹ Description

β€’ Design and build the AI evaluation suite used to measure and improve AI output quality β€’ Build across the full stack, including data pipelines, backend services and front-end tools β€’ Work with prompt engineers and subject matter experts to turn knowledge into tests, metrics and tooling β€’ Help define AI quality measurement practices β€’ Automate evaluation processes and results within the software development lifecycle β€’ Contribute over time to AI-powered products β€’ Deliver an evaluation suite used by engineering teams after three months β€’ Extend evaluations across all AI products and integrate them into the SDLC after six months β€’ Establish evaluation as a standard part of AI delivery and become a trusted voice on AI quality after twelve months

🎯 Requirements

β€’ Upper mid-level to senior professional software engineering experience β€’ Experience building AI powered products or tooling β€’ Full-stack experience across front end and back end β€’ Comfortable working independently and in ambiguity, setting own direction β€’ Experience collaborating with non-engineers and turning their expertise into working software β€’ Strong focus on quality, testing and attention to detail β€’ Experience using AI coding tools in day-to-day work β€’ Fluent written and spoken English β€’ Nice to have: experience building evaluation suites for AI products β€’ Nice to have: experience with Python and TypeScript β€’ Nice to have: experience building internal tools, testing frameworks or data pipelines β€’ Nice to have: experience at a startup or in a small team building things end to end

πŸ–οΈ Benefits

β€’ Pension scheme β€’ Personal performance bonus β€’ 26 days holiday each calendar year β€’ Bupa health & dental cover β€’ Group life assurance β€’ EAP β€’ Cycle to work scheme β€’ Diversity, equity and inclusion β€’ Reasonable adjustments accommodated during the hiring process

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 7

ElevenLabs

1 - 10

πŸ€– Artificial Intelligence

πŸ“± Media

Applied AI Engineer building reliable, measurable agents for ElevenLabs’ AI platforms. Forward-deployed with growth teams to ship production LLM systems.

πŸ•’ October 6

NVIDIA

10,000+ employees

πŸ₯ Healthcare

🏭 Manufacturing

πŸ€– Artificial Intelligence

Senior C++ engineer building NVIDIA’s AI-powered developer tools and Genie integrations. Developing high-performance systems connecting native applications with retrieval and agentic AI services.

πŸ•’ September 22

Runware

11 - 50

πŸ€– Artificial Intelligence

πŸ”Œ API

πŸ“± Media

Creative Engineer exploring generative image and video models for Runware. Building ComfyUI workflows, demos, and technical content for developers and creators.

πŸ•’ September 17

Paddle

201 - 500

☁️ SaaS

πŸ’³ Fintech

🀝 B2B

Senior AI Engineer building production AI systems for Paddle, a Merchant of Record for digital product companies. Automating GTM workflows across segmentation, account research and sales operations.

πŸ•’ September 11

Mapbox

501 - 1000

🚘 Automotive

πŸ“¦ Logistics

✈️ Travel

Senior AI Engineer building evaluation-driven LLM systems, data pipelines, and agent tooling for Mapbox's real-time location platform. Owning production AI quality, latency, and reliability across teams.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok