Product Lead, AI Agent Evaluation – Research Products

Job not on LinkedIn

🕒 October 30

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

Where this job comes from

Posted on Sentient Foundation's careers page ↗Sentient Foundation's careers page, not through a job board

First seen by Remote Rocketship October 30

Still open on Sentient Foundation's site. Checked 28 minutes ago.

Apply Now
Logo of Sentient Foundation

Sentient Foundation

11 - 50 employees

🤖 Artificial Intelligence

🤝 Non-profit

₿ Crypto

Artificial Intelligence • Non-profit • Crypto

Sentient Foundation is pioneering a new era in AI, empowering communities to create Loyal AI—community-built, community-aligned, and community-owned. As a non-profit committed to advancing open-source AI technologies and building a decentralized, transparent ecosystem, we champion an Open AI economy where AI builders are key stakeholders. With AGI on the horizon, our mission is to ensure it serves humanity, not corporations.

📋 Description

• Own 0-to-1 product launches for AI agent and eval products, including benchmarks, leaderboards, datasets, developer challenges, research demos, and open-source releases • Translate research agendas into concrete product specs, user journeys, launch plans, success metrics, and roadmap priorities • Work with researchers to package technical work into usable artifacts: docs, examples, benchmarks, rubrics, eval harnesses, blog posts, landing pages, and demos • Drive developer-facing programs like competitions, cohorts, hackathons, public challenges, and partner-backed benchmark launches • Define the product experience around agent improvement loops: task definition, requirement mining, skill discovery, adaptation, evaluation, and performance improvement • Coordinate engineering, design, research, community, marketing, and BD so releases ship with polish and momentum • Identify target users, including AI developers, researchers, enterprise teams, open-source builders, and technical partners • Collect feedback from users and partners, then turn it into product improvements, research questions, and follow-on releases • Build launch narratives that make technical work legible and exciting without oversimplifying the research

🎯 Requirements

• 4+ years in product, technical product, founder, developer platform, AI tooling, or research-product roles • Strong understanding of modern AI agents, evals, benchmarks, LLM workflows, and open-source/developer ecosystems • Proven ability to ship ambiguous technical products from concept to launch • Excellent writing and communication skills; can turn complex research into clear product positioning • High agency and comfort working across research, engineering, GTM, community, and external partners • Strong product taste: knows when a research artifact is not yet a product, and what it needs to become one • Comfortable reading papers, discussing eval design, and working with technical users • Prior startup experience is a plus • Bonus: experience with AI/ML infrastructure, LLM evals, Python, open-source launches, developer communities, hackathons, or benchmark design

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 30

Littlebird

11 - 50

🤖 Artificial Intelligence

☁️ SaaS

⚡ Productivity

Applied AI Engineer improving retrieval, ranking, and agent reasoning for Littlebird, a personal AI connecting users’ digital lives. Building scalable, reliable RAG and tool-calling systems.

🇺🇸 United States – Remote

🔥 Funding within the last year

💰 $11M Seed Round on 2026-03

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 October 30

Félix

51 - 200

🤝 B2B

Staff Product Designer shaping conversational and generative UI for Félix’s AI-powered cross-border financial platform. Defining WhatsApp, iOS, and Android experiences for Latino users in the US.

🗣️🇪🇸 Spanish Required

🕒 October 30

Félix

51 - 200

🤝 B2B

Staff Product Designer defining generative and declarative UI for Félix’s AI-powered remittance and fintech platform. Shipping conversational experiences across WhatsApp, iOS, and Android.

🗣️🇪🇸 Spanish Required

🕒 October 30

BigPanda

201 - 500

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Senior Software Engineer building AI infrastructure for BigPanda's IT operations automation platform. Shipping agentic capabilities, data ingestion, and enterprise integrations.

🕒 October 30

Basalt Health

11 - 50

🏥 Healthcare

🤖 Artificial Intelligence

☁️ SaaS

Staff AI Engineer building LLM orchestration, retrieval, and evaluation systems for healthcare coordination software. Shipping Python and TypeScript AI infrastructure into production.

🇺🇸 United States – Remote

💵 $150k - $220k / year

🔥 Funding within the last year

💰 $20M Series A on 2026-09

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 AI Engineer

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok