Product Lead, AI Agent Evaluation – Research Products

Job not on LinkedIn

🔥 5 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🤖 AI Engineer

👻 Ghost score 13%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Sentient Foundation

WebsiteLinkedInAll Job Openings

11 - 50 employees

🤖 Artificial Intelligence

🤝 Non-profit

₿ Crypto

Artificial Intelligence • Non-profit • Crypto

Sentient Foundation is pioneering a new era in AI, empowering communities to create Loyal AI—community-built, community-aligned, and community-owned. As a non-profit committed to advancing open-source AI technologies and building a decentralized, transparent ecosystem, we champion an Open AI economy where AI builders are key stakeholders. With AGI on the horizon, our mission is to ensure it serves humanity, not corporations.

📋 Description

• Own 0-to-1 product launches for AI agent and eval products, including benchmarks, leaderboards, datasets, developer challenges, research demos, and open-source releases • Translate research agendas into concrete product specs, user journeys, launch plans, success metrics, and roadmap priorities • Work with researchers to package technical work into usable artifacts: docs, examples, benchmarks, rubrics, eval harnesses, blog posts, landing pages, and demos • Drive developer-facing programs like competitions, cohorts, hackathons, public challenges, and partner-backed benchmark launches • Define the product experience around agent improvement loops: task definition, requirement mining, skill discovery, adaptation, evaluation, and performance improvement • Coordinate engineering, design, research, community, marketing, and BD so releases ship with polish and momentum • Identify target users, including AI developers, researchers, enterprise teams, open-source builders, and technical partners • Collect feedback from users and partners, then turn it into product improvements, research questions, and follow-on releases • Build launch narratives that make technical work legible and exciting without oversimplifying the research

🎯 Requirements

• 4+ years in product, technical product, founder, developer platform, AI tooling, or research-product roles • Strong understanding of modern AI agents, evals, benchmarks, LLM workflows, and open-source/developer ecosystems • Proven ability to ship ambiguous technical products from concept to launch • Excellent writing and communication skills; can turn complex research into clear product positioning • High agency and comfort working across research, engineering, GTM, community, and external partners • Strong product taste: knows when a research artifact is not yet a product, and what it needs to become one • Comfortable reading papers, discussing eval design, and working with technical users • Prior startup experience is a plus • Bonus: experience with AI/ML infrastructure, LLM evals, Python, open-source launches, developer communities, hackathons, or benchmark design

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume