Lead Engineer, AI Platform

🔥 4 minutes ago

🇪🇺 Europe – Remote

💵 $170k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Circle

WebsiteLinkedInAll Job Openings

51 - 200 employees

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

Circle is an all-in-one community platform designed for creators, brands, and startups to build, engage, and monetize their communities. It integrates tools for discussions, events, courses, and membership management into a seamless experience under one customizable brand. Circle offers features such as live streaming, gamified rewards, member directories, and extensive integrations with existing tools, allowing users to create private spaces, automate workflows, and manage payments. This platform is ideal for building different types of communities including customer, course, and coaching groups, providing a space for collaboration, interaction, and growth.

📋 Description

• Build and own evaluation infrastructure for Circle’s AI agents • Design CI/CD pipelines, scorers, and datasets for evaluating agent performance • Diagnose failures across agent pipelines, including planning, execution, tool selection, and tool trajectories • Turn diagnostic findings into prototypes or priorities for AI Core engineering • Build annotation workflows and AI-generated or simulated conversations • Run structured experiments across prompts, models, and the agent harness • Evaluate new and open-source models against production baselines • Optimize cost and latency through model swaps, caching, and routing by plan complexity • Lead and manage the AI Quality engineering team while remaining hands-on in code • Set technical direction and manage day-to-day priorities • Partner with AI Core engineering to validate quality improvements

🎯 Requirements

• 7+ years of experience building and shipping production software • Experience with LLM-powered agents that take real actions in a product • Experience with complex tool-using systems, including multiple tools, planning or orchestration, and sub-agents • Comfortable with Ruby on Rails and Python, or able to pick them up quickly • Experience building evaluation or observability infrastructure for ML/AI systems • Experience with eval pipelines, scorers, dashboards, or CI/CD for evaluations • Experience with evaluation frameworks such as Braintrust, LangSmith, or similar • Experience designing datasets, annotation workflows, or labeling pipelines for ML/AI evaluation • Ability to learn quickly and experiment aggressively in a dynamic environment • Comfort working in a fast-paced environment with ambiguity • Strong alignment with company values • Proficient in English at CEFR Level C2 / ILR Level 5

🏖️ Benefits

• Equity in the company with ongoing refresh grants • 35 days of paid time off each year • Remote-only work • Incredible flexibility and autonomy • Benefits package supporting health, wellbeing, and professional growth • Twice-yearly company retreats/offsites • U.S.-benchmarked compensation globally

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume