Lead Product Manager, Agent Runtime, Evals

Job not on LinkedIn

🔥 8 minutes ago

🌐 United States, Canada – Remote

🇺🇸 United States – Remote 🇨🇦 Canada – Remote

💵 $200k - $230k / year

⏰ Full Time

🟠 Senior

✅ Product Manager

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Juniper Square

WebsiteLinkedInAll Job Openings

201 - 500 employees

💸 Finance

🏠 Real Estate

☁️ SaaS

💰 $75M Series C on 2019-11

Finance • Real Estate • SaaS

Juniper Square is a company that provides a comprehensive platform and solutions tailored for private investment partnerships. Founded in 2014, the company focuses on enabling seamless connection and communication between General Partners (GPs) and Limited Partners (LPs) throughout the entire investment lifecycle. Juniper Square's technology is purpose-built to support commercial real estate, private equity, and venture capital firms of all sizes. The platform offers services such as fund administration, fundraising, investor management, compliance, and investor reporting, all aimed at enhancing transparency, data governance, and the overall investor experience.

📋 Description

• Own the vision, strategy, and roadmap for Foundry’s agent runtime and evaluation layer • Define the lifecycle for agents, apps, and scripts: draft, test, publish, version, deploy, run, observe, improve, and retire • Define evaluation processes using golden datasets, data labeling, regression gates, automated judges, and human review • Shape model eligibility, routing, cost attribution, and pricing for automations • Define agent memory, learning, self-improvement, identity, access grants, and run modes • Integrate hosted agents with Juniper Square products, fund administration systems, and third-party tools • Design oversight tools including dashboards, run history, traces, metrics, logs, kill switches, and auditability • Partner with the workflow orchestration PM on agent registries, typed contracts, and workflow bindings • Build configuration tools for business SMEs to configure, test, and tune automations • Track the managed agent runtime, framework, and automation-platform market and make build, buy, and partner decisions • Lead across platform and adjacent teams and guide ambiguous platform tradeoffs • Report to the Group Product Manager for Foundry and work with a dedicated engineering team • Deliver real fund administration workflows and automations on Foundry, including capital calls and distributions

🎯 Requirements

• 7+ years of product management experience in B2B or Enterprise SaaS, including 3+ years operating in an AI-oriented role • Proven experience owning a complex product area end-to-end, from strategy and roadmap through execution and iteration, ideally in a zero-to-one context • Hands-on understanding of agent evaluation, including golden datasets, data labeling, automated judges, regression testing, and human-in-the-loop decisions • Background building agents and replacing human-driven processes with products and automation, with real evaluation and monitoring discipline in production • Strong engineering partnership and understanding of typed contracts between agents and workflows, structured and deterministic outputs, and agent memory • User empathy for non-engineering builders and operators overseeing large numbers of automated agents • Fluency with LLMs and common AI tools such as Claude and Cursor • Ability to run prototypes and use AI tools to accelerate product work • Strong written and verbal communication skills • Track record of leading through influence, ideally mentoring or managing other product managers, and setting strategy across multiple teams

🏖️ Benefits

• Health, dental, and vision care for you and your family • Life insurance • Mental wellness coverage • Fertility and growing family support • Flex Time Off in addition to company-paid holidays • Paid family leave, medical leave, and bereavement leave policies • Retirement saving plans • Allowance to customize your work and technology setup at home • Annual professional development stipend • Equity

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume