Lead Engineer, AI Platform

🔥 13 hours ago

🇪🇺 Europe – Remote

💵 $170k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

👻 Ghost score 1%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Circle

WebsiteLinkedInAll Job Openings

51 - 200 employees

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

Circle is an all-in-one community platform designed for creators, brands, and startups to build, engage, and monetize their communities. It integrates tools for discussions, events, courses, and membership management into a seamless experience under one customizable brand. Circle offers features such as live streaming, gamified rewards, member directories, and extensive integrations with existing tools, allowing users to create private spaces, automate workflows, and manage payments. This platform is ideal for building different types of communities including customer, course, and coaching groups, providing a space for collaboration, interaction, and growth.

📋 Description

• Build and own evaluation infrastructure, including CI/CD pipelines, scorers, and datasets for Circle’s AI agents • Diagnose failures across the agent pipeline, including planning, execution, tool selection, and tool trajectories • Turn diagnostic findings into prototypes or priorities for AI Core engineering • Establish annotation workflows and build AI-generated and simulated conversations for evaluation datasets • Run structured experiments across prompts, models, and the agent harness • Evaluate new and open-source models against production baselines • Build frameworks for model-shift decisions and optimize cost and latency through model swaps, caching, and routing • Lead and manage the AI Quality engineering team while remaining hands-on in code • Set technical direction and manage day-to-day priorities • Partner with AI Core engineering to validate quality improvements

🎯 Requirements

• 7+ years of experience building and shipping production software, ideally including LLM-powered agents that take real actions in a product • Experience with complex, tool-using systems, including multiple tools, planning or orchestration, and sub-agents • Comfortable in Ruby on Rails / Python or ready to pick them up quickly • Proficiency in Python is a strong plus, especially for data and evaluation work • Experience building evaluation or observability infrastructure for ML/AI systems • Experience with evaluation frameworks like Braintrust, LangSmith, or similar • Experience designing datasets, annotation workflows, or labeling pipelines for ML/AI evaluation • Ability to learn quickly, experiment aggressively, and thrive in a highly dynamic environment • Comfort working in a fast-paced environment with ambiguity • Strong alignment with company values • Proficient in English, spoken, written, and reading, at CEFR Level C2 / ILR Level 5

🏖️ Benefits

• Equity in the company with ongoing refresh grants • 35 days of paid time off each year • Remote-only work with flexibility and autonomy • Company retreats twice a year in incredible destinations around the world • Benefits package supporting health, wellbeing, and professional growth

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume