Clinical AI Quality Specialist

πŸ•’ Yesterday

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $130k - $143k / year

⏰ Full Time

🟑 Mid-level

πŸ€– Artificial Intelligence

Where this job comes from

Posted on Hello Heart's careers page β†—Hello Heart's careers page, not through a job board

First seen by Remote Rocketship Yesterday

Still open on Hello Heart's site. Checked 1 hour ago.

Apply Now
Logo of Hello Heart

Hello Heart

51 - 200 employees

Founded 2013

πŸ₯ Healthcare

πŸ’Ό Consulting

🧘 Wellness

Healthcare β€’ Consulting β€’ Wellness

Hello Heart is a healthcare technology company offering a mobile app to help individuals track and improve their heart health. The app provides real-time tips, allows users to track their blood pressure, and offers personalized insights to help users manage their heart health more effectively. Hello Heart also partners with businesses, health plans, and labor unions to provide these tools to their employees and members, demonstrating a significant impact on heart health outcomes through personalized and data-driven approaches. Privacy and security of health data are prioritized, ensuring members' health information is protected.

πŸ“‹ Description

β€’ Run Nia’s offline evaluations for clinically relevant changes β€’ Write test cases, including tricky and ambiguous ones, and score outputs against expected clinical behavior β€’ Build and maintain evaluation datasets and contribute to scoring methods β€’ Review production conversations using defined sampling methods β€’ Take part in weekly reviews and help prepare monthly results stating what was and wasn’t covered β€’ Test whether Nia detects and correctly handles medical emergencies, self-harm, and medication safety situations β€’ Measure over-escalation and under-escalation β€’ Describe failures clearly enough for engineering to act on and identify likely causes β€’ Ensure each unsafe or incorrect finding has an owner, ticket, and decision β€’ Keep clinical specifications, review records, and evidence current and auditable β€’ Write clear, precise clinical assessments for engineering and product

🎯 Requirements

β€’ PharmD (or equivalent clinical doctorate) with an active US license β€’ 3+ years of combined clinical practice and clinical AI evaluation β€’ Questions assumptions and investigates before drawing conclusions β€’ Reads current guidelines, drug labels, and primary sources, and cites them in written assessments β€’ Uses AI tools to work faster, and verifies AI output against sources before relying on it β€’ Experience designing or running evaluations for LLM-based systems β€’ Experience reviewing production conversations β€’ Experience using monitoring tools (e.g., Langfuse) β€’ Command of triage and escalation, crisis and self-harm handling, and medication safety, grounded in current guidelines β€’ Comfortable working with AI tools and evaluation workflows β€’ Excellent written and verbal communication β€’ Ability to explain clinical risk clearly to engineering and product audiences β€’ Ability to write precise clinical assessments and documentation β€’ Genuine passion for how AI can improve preventive care and chronic disease management β€’ Curiosity, openness to learning, and comfort with ambiguity and a fast-moving field

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ Yesterday

Stripe

1001 - 5000

πŸ’³ Fintech

πŸ›οΈ eCommerce

🀝 B2B

Stripe, a financial infrastructure platform, seeks an AI accelerator to transform marketers' workflows. Building agents, automations, and AI-first operating practices across marketing cohorts.

πŸ•’ Yesterday

Stripe

1001 - 5000

πŸ’³ Fintech

πŸ›οΈ eCommerce

🀝 B2B

Stripe AI transformation lead building agents, automations, and tools for marketers. Scaling AI-first workflows across cohorts at Stripe, a financial infrastructure platform.

πŸ•’ Yesterday

Ivanti

1001 - 5000

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Senior AI Compliance Analyst governing responsible AI compliance at Ivanti, which manages, protects, and automates organizational technology. Assessing AI systems, regulations, controls, and governance across their lifecycle.

πŸ•’ Yesterday

TDS Global Solutions

51 - 200

πŸ’Ό Consulting

🎯 Recruiter

🀝 B2B

Forward Deployed Engineer building production AI applications and scalable software for startups and high-growth technology companies. Translating customer requirements into deployed, integrated technical solutions.

πŸ•’ Yesterday

Vertical Relevance

51 - 200

πŸ’Ό Consulting

πŸ“£ Marketing

πŸ₯ Healthcare

Agentic AI/ML Consultant designing and deploying secure RAG, knowledge graph, and cloud solutions. Advising Vertical Relevance clients on measurable business transformation outcomes.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok