AI Product Lead – AI Experience, Quality

Vaga não está no LinkedIn

🕒 Setembro 23

🏄 California – Remoto

infoinfo

💵 $150.000 - $200.000 / ano

⏰ Tempo Integral

🟠 Sênior

🤖 Engenheiro de IA

👻 Score fantasma 0%

infoinfo

🗣️🇺🇸🇬🇧 Inglês obrigatório

Candidatar-se
Encontrar Vagas Remotas Similares

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Logo of Flodesk

Flodesk

11 - 50 funcionários

Fundada em 2017

☁️ SaaS

🛍️ Comércio Eletrônico

📣 Marketing

SaaS • eCommerce • Marketing

A Flodesk é uma empresa que oferece ferramentas de software simples e intuitivas para email marketing, permitindo que empreendedores e pequenas empresas expandam seus negócios. A plataforma possibilita que os usuários projetem e enviem e-mails de marketing alinhados com a marca, criem páginas de vendas, aceitem pagamentos online e utilizem formulários de opt-in para aumentar suas listas. Com templates bonitos e personalizáveis e capacidades avançadas de automação, a Flodesk busca simplificar o processo de marketing. Ela também oferece análises robustas para entender o desempenho das campanhas e integrações com várias ferramentas de terceiros via API. A Flodesk atende empresas de todos os tamanhos com opções de planos personalizados e fornece recursos através da Flodesk University para treinamento na plataforma.

Descrição

• Manage member-facing AI behavior across prompt-to-create, agentic editing, segmentation, scheduling, analytics and recommendations • Create, test, version and document prompts and agent instructions • Define required context, member data, tools and product state, translating them into requirements and acceptance criteria • Own AI evaluation practice, including datasets, behavioral scenarios, scoring rubrics, regression coverage and human review • Run recurring evaluation and quality monitoring; set baselines and release gates for prompt, model and agent changes • Review traces and AI interactions to diagnose failures across prompts, context, models, tools, product structure and implementation • Fix owned issues and provide actionable changes for engineering • Turn member research, support feedback, analytics, production failures and domain expertise into priorities, experiments and regression cases • Own day-to-day product direction and learning agenda for the AI experience • Partner with product, design, marketing, copy and engineering

🎯 Requisitos

• Shaped or meaningfully improved real LLM or agentic products, with evidence of improved user outcomes or product quality • Practical knowledge of prompts, context, tools, agent behavior and evaluation in production experiences • Hands-on experience with prompt iteration, evaluation tools and trace review • Comfortable working with JSON, schemas and structured outputs • Strong product judgment and ability to turn ambiguous member needs into clear behavior, quality definitions and testable hypotheses • Experimental rigor, including representative test sets and failure taxonomies • Systems thinking and ability to create reusable patterns • Clear communication across technical and non-technical disciplines • Ability to make tradeoffs involving member value, quality, latency, reliability and cost • Not expected to build or deploy production code, but must operate the prompt and evaluation system independently • Bonus: experience with AI product behavior, conversation design, computational linguistics or prompt systems • Bonus: experience building content-generation, creative or marketing tools • Bonus: experience with Langfuse, Braintrust or comparable evaluation and observability platforms • Bonus: experience working on products for small businesses, creators or marketers

🏖️ Benefícios

• Fully paid health insurance for individual coverage • 16 weeks paid parental leave for non-birthing parents • 22 weeks paid maternity leave for birthing parents • Unlimited flexible time off • 401(k) match (US employees only) • $1,000 annual stipend for learning and development

Candidatar-se

Vagas Similares

🕒 Setembro 22

GuidePoint Security

201 - 500

💼 Consultoria

🏥 Saúde

📦 Logística

Senior engineer securing AI/ML platforms across AWS, Azure, and Google Cloud for GuidePoint Security, a cybersecurity solutions provider. Leading automation, governance, consulting delivery, and presales support.

🗣️🇺🇸🇬🇧 Inglês obrigatório

🕒 Setembro 22

American Express

10.000+ funcionários

🏦 Bancário

💸 Finanças

🤝 B2B

Senior AI Engineer building production agentic AI services for American Express Global Commercial Services. Developing RAG, evaluations, orchestration, and reliable AI infrastructure for business-payment experiences.

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $123.000 - $215.250 / ano

⏰ Tempo Integral

🟠 Sênior

🤖 Engenheiro de IA

🗣️🇺🇸🇬🇧 Inglês obrigatório

🕒 Setembro 22

American Express

10.000+ funcionários

🏦 Bancário

💸 Finanças

🤝 B2B

Senior AI Engineer building production agentic AI systems for American Express business customers. Owning agent frameworks, LLM evaluations, RAG pipelines, and reliable cloud services.

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $123.000 - $215.250 / ano

⏰ Tempo Integral

🟠 Sênior

🤖 Engenheiro de IA

🗣️🇺🇸🇬🇧 Inglês obrigatório

🕒 Setembro 22

Parallel Partners

1 - 10

💳 Fintech

🤝 B2B

Applied AI Engineer building production LLM features and automation for insurance workflows. Integrating reliable AI into APIs, user experiences, and decision-support systems.

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $140.000 - $200.000 / ano

⏰ Tempo Integral

🟡 Pleno

🟠 Sênior

🤖 Engenheiro de IA

🗣️🇺🇸🇬🇧 Inglês obrigatório

🕒 Setembro 22

Parallel Partners

1 - 10

💳 Fintech

🤝 B2B

iOS Software Engineer building Swift mobile apps for insurance and financial products. Developing reliable user flows and AI-assisted features for a global engineering team.

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $120.000 - $175.000 / ano

⏰ Tempo Integral

🟡 Pleno

🟠 Sênior

🤖 Engenheiro de IA

🗣️🇺🇸🇬🇧 Inglês obrigatório