AI Product Lead – AI Experience, Quality

Job not on LinkedIn

🔥 1 minute ago

🏄 California – Remote

🏄 California – Remote

💵 $150k - $200k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Flodesk

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2017

☁️ SaaS

🛍️ eCommerce

📣 Marketing

SaaS • eCommerce • Marketing

Flodesk is a company that provides simple and intuitive software tools for email marketing, allowing entrepreneurs and small businesses to grow their business. The platform enables users to design and send on-brand marketing emails, create sales pages, accept online payments, and utilize opt-in forms to grow their lists. Featuring beautiful, customizable templates and advanced automation capabilities, Flodesk aims to simplify the marketing process. It also offers robust analytics to understand the performance of campaigns and connections to various third-party tools via API. Flodesk caters to businesses of all sizes with options for custom plans and provides resources through Flodesk University for training on the platform.

📋 Description

• Manage member-facing AI behavior across prompt-to-create, agentic editing, segmentation, scheduling, analytics and recommendations • Create, test, version and document prompts and agent instructions • Define required context, member data, tools and product state, translating them into requirements and acceptance criteria • Own AI evaluation practice, including datasets, behavioral scenarios, scoring rubrics, regression coverage and human review • Run recurring evaluation and quality monitoring; set baselines and release gates for prompt, model and agent changes • Review traces and AI interactions to diagnose failures across prompts, context, models, tools, product structure and implementation • Fix owned issues and provide actionable changes for engineering • Turn member research, support feedback, analytics, production failures and domain expertise into priorities, experiments and regression cases • Own day-to-day product direction and learning agenda for the AI experience • Partner with product, design, marketing, copy and engineering

🎯 Requirements

• Shaped or meaningfully improved real LLM or agentic products, with evidence of improved user outcomes or product quality • Practical knowledge of prompts, context, tools, agent behavior and evaluation in production experiences • Hands-on experience with prompt iteration, evaluation tools and trace review • Comfortable working with JSON, schemas and structured outputs • Strong product judgment and ability to turn ambiguous member needs into clear behavior, quality definitions and testable hypotheses • Experimental rigor, including representative test sets and failure taxonomies • Systems thinking and ability to create reusable patterns • Clear communication across technical and non-technical disciplines • Ability to make tradeoffs involving member value, quality, latency, reliability and cost • Not expected to build or deploy production code, but must operate the prompt and evaluation system independently • Bonus: experience with AI product behavior, conversation design, computational linguistics or prompt systems • Bonus: experience building content-generation, creative or marketing tools • Bonus: experience with Langfuse, Braintrust or comparable evaluation and observability platforms • Bonus: experience working on products for small businesses, creators or marketers

🏖️ Benefits

• Fully paid health insurance for individual coverage • 16 weeks paid parental leave for non-birthing parents • 22 weeks paid maternity leave for birthing parents • Unlimited flexible time off • 401(k) match (US employees only) • $1,000 annual stipend for learning and development