Technical Product Manager – Pedagogy, AI Quality

Job not on LinkedIn

🔥 4 minutes ago

🇺🇸 United States – Remote

💵 $130k - $150k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

⚒️ Technical Product Manager (TPM)

👻 Ghost score 4%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Workshop Venture Partners

WebsiteLinkedInAll Job Openings

2 - 10 employees

📚 Education

⚡ Energy

🌍 Social Impact

Education • Energy • Social Impact

Workshop Venture Partners is a venture studio and early-stage investor that builds and invests alongside founders focused on climate and education. The firm pairs a small, hands-on team of engineers and operators with founders, offering co‑founder mentality support, rapid product development, market validation, and tailored resources while investing at the pre-seed and seed stages. Founded by entrepreneurs who scaled SimpliSafe, Workshop runs a studio arm that partners deeply with 2–4 companies at a time and an investment arm that backs promising education and climate startups.

📋 Description

• Define quality standards and targets for high-quality reading and writing scaffolds based on research in literacy, special education, and multilingual learner instruction • Build and maintain datasets, rubrics, and evaluation suites • Conduct regular error analysis and trace review using human labeling, LLM-as-judge, and rule-based evaluations • Write, test, and refine prompts • Run model comparisons and regression tests • Review educator signals, support-ticket data, product analytics, and conduct user research with students and teachers • Maintain a prioritized backlog of AI quality and scaffold UX issues • Write clear product specifications • Partner with engineering to scope, build, and verify fixes, product updates, and new features • Own the quality and usability of Medley’s scaffold suite over time • Prioritize product improvements and new features to support teachers and improve student outcomes

🎯 Requirements

• Pedagogical expertise, especially in scaffolding literacy instruction for struggling readers, special education, and/or multilingual learner education • Ideally from classroom teaching, intervention, instructional coaching or curriculum design • Hands-on experience with AI evals, including human labeling, LLM-as-judge rubric design, AI metrics targets definition, and error analysis of LLM outputs • AI product fluency; daily use of LLMs and experience designing complex AI systems for products • Experience defining new features and collaborating with engineers to deliver them • Ability to clearly communicate problems and solutions and work through technical tradeoffs and UX questions • Strong initiative, sharp judgment, and clear writing • Graduate degree and/or significant direct experience in special education, reading/literacy, ESL/ELD or bilingual education is nice to have • Familiarity with AI eval and observability tools such as LangSmith, Braintrust, Arize, Langfuse, or annotation platforms is nice to have • Proficiency in a language other than English is nice to have • Prior work at an edtech company, or on content quality, assessment design or psychometrics is nice to have • Familiarity with accessibility standards such as WCAG and assistive technology is nice to have • Must address work authorization sponsorship question for the United States

🏖️ Benefits

• Equity • Work directly with founders and engineering leadership • Meaningful technical and design ownership • Opportunity to shape a product improving access to learning for students nationwide

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume