Senior Director, Technical Product Management – AI Quality & Evaluation

Job not on LinkedIn

🔥 0 minutes ago

🏄 California, Washington – Remote

🏄 California – Remote ☕ Washington – Remote

💵 $218.4k - $365.2k / year

⏰ Full Time

🟠 Senior

✅ Product Manager

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Salesforce

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1999

💼 Consulting

📣 Marketing

☁️ SaaS

Consulting • Marketing • SaaS

Salesforce is a leading cloud-based software company that provides a comprehensive customer relationship management (CRM) platform. The platform connects all company data and teams on an integrated, AI-driven system to improve sales, customer service, and marketing efforts. Salesforce offers scalable solutions for businesses of all sizes, including small and medium enterprises, and provides industry-specific solutions to modernize operations, save time, and reduce costs. Salesforce also offers educational resources through Trailhead and a wide selection of apps on AppExchange to extend its CRM capabilities.

📋 Description

• Build the next generation of Agentforce within Salesforce’s entrepreneurial incubation team • Shape product strategy for AI quality and evaluation • Establish how AI progress is measured, including quality definitions, evaluation requirements, coverage priorities, and release criteria • Set product strategy and roadmap connecting customer needs, technical opportunities, and measurable business outcomes • Make investment tradeoffs across customer quality improvements, evaluation capabilities, and product features • Lead customer investigations and experiments into incorrect agent answers and failed tool-driven workflows • Define expected behavior and partner with researchers and engineers to test changes and validate customer impact • Build an operating approach connecting customer feedback, evaluation evidence, experiments, releases, and learning • Partner with researchers, applied scientists, and engineers to design credible evaluations • Lead delivery of capabilities that help customers understand and improve AI performance • Coach product partners, junior designers, and technical program managers • Bring verified competitive insight into strategy and communicate differentiation, limitations, and investment choices • Independently take quality problems from failure analysis through experimentation and customer validation • Deliver a focused feature with engineering and improve release and investment decisions through evidence and product judgment

🎯 Requirements

• Record of building AI/ML products and delivering measurable customer outcomes, with increasing ownership, scope, and impact • Deep hands-on experience building AI agents and evaluation capabilities with AI researchers, applied scientists, or AI engineers • One to two years of substantive generative AI experience can be sufficient when supported by strong AI/ML fundamentals and demonstrated impact • Strong applied AI/ML judgment across model behavior, prompting, retrieval, agent/tool workflows, and tradeoffs among model, data, system, and product improvements • Current hands-on ability to inspect data and traces, prototype with coding agents, and reason about experiments, overfitting, training/test splits, edge cases, and uncertainty • Ability to define quality for a non-deterministic system and challenge technical conclusions • Experience establishing shared standards and resolving cross-team disagreements while preserving accountability and delivery momentum • Evidence of coaching and mentoring colleagues without reporting authority • Ability to deliver independently in a fast-moving environment • Clear communication with customers, technical teams, and senior leaders • Preferred: evaluation platforms, agent systems, AI observability, retrieval, or enterprise AI products • Preferred: experience in an AI-native startup or entrepreneurial environment • Preferred: hands-on prototyping with coding agents and customer-facing performance or outcome experiences • Preferred: leading initiatives across research, engineering, product, and customer-facing organizations

🏖️ Benefits

• Time off programs • Medical insurance • Dental insurance • Vision insurance • Mental health support • Paid parental leave • Life insurance • Disability insurance • 401(k) • Employee stock purchasing program • Certain roles may be eligible for incentive compensation and equity • Reasonable accommodation during the application or recruiting process

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume