Senior Product Engineer – Agent Training and Evals

🕒 September 11

🇬🇧 United Kingdom – Remote

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🇬🇧 UK Skilled Worker Visa Sponsor

This company has sponsored UK Skilled Worker visas in the past.

👻 Ghost score 14%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Prolific

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2014

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Prolific is a platform that facilitates fast and high-quality data collection by connecting researchers with participants, including AI taskers. Researchers can launch tasks, surveys, and experiments and receive responses from a global community of over 200,000 active participants within hours. Prolific prides itself on providing accurate and detailed data while ensuring that participants are fairly rewarded for their contributions. The platform is trusted by leading academics and organizations for its flexibility, simplicity, and rapid project execution.

📋 Description

• Build tooling for capturing and processing data from agents and humans performing real-world tasks, at significant scale • Solve hard problems around compute, orchestration, scaling, security and reliability • Help develop approaches for training, benchmarking and evaluating AI agents • Work with emerging agentic AI technologies and rapidly evolving models • Make pragmatic technical decisions in a highly ambiguous environment • Partner closely with product engineering and AI research to turn customer problems into working products • Drive direct impact in a fast-moving, high-ownership, cross-functional team

🎯 Requirements

• Strong experience building scalable infrastructure or distributed systems in the cloud • Solid understanding of how systems are deployed, scaled and secured • Hands-on experience with integrating and evaluating AI models or agents • Interest in how AI agents are trained, evaluated and improved • Strong product mindset with a focus on delivering business and customer value • Comfort with ambiguity, and the ability to move quickly from idea to working system • Strong communication and collaboration skills • Python experience is useful, but not essential • Bonus: experience with image, video, or audio processing

🏖️ Benefits

• Competitive salary • Benefits • Remote working • Access to Prolific's unique human data platform • Opportunities for groundbreaking research