Behavioral Health Expert – AI Safety, Model Evaluation

🔥 12 hours ago

🇺🇸 United States – Remote

💵 $45 - $70 / hour

⏱ Part Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 8%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Mercor

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2023

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

Mercor is a company for which no descriptive text was provided in the input. Additional information (products, services, target customers, or industry specifics) is needed to create an accurate summary and select appropriate industries.

📋 Description

• Evaluate conversations between users and AI models on relationship and family advice, emotional wellbeing, spiritual and metaphysical questions, and unconventional or unfounded beliefs • Assess whether model responses are neutral, appropriate and safe • Identify and document concerns such as excessive agreement, taking sides, reinforcing distorted or unfounded beliefs, moralizing, or overstepping into clinical or directive advice • Develop rubrics, guidelines and reference responses for balanced, supportive and appropriately bounded replies • Design test scenarios and conversations for sensitive, non-crisis topics • Collaborate with lab researchers and fellow experts to maintain consistent, calibrated and well-documented evaluation standards

🎯 Requirements

• Degree in psychology, counseling, social work, behavioral health, behavioral science, human services or a closely related field, or equivalent professional experience in the mental health field • 3+ years of professional experience supporting people in a mental health, counseling or social services setting • Ability to remain neutral and nonjudgmental across diverse perspectives, relationships, belief systems and worldviews • Ability to explain the reasoning behind professional judgments • Working familiarity with sycophancy, cognitive distortions, healthy boundaries and client-centered approaches such as motivational interviewing • Ability to engage reliably for at least 20 hours per week during weekdays • Strong written communication skills and ability to deliver precise, well-structured written feedback • Clinical licensure is valued but not required • Nice to have: background in AI safety, applied ethics, trust and safety or content policy • Nice to have: experience in couples, family or relationship counseling • Nice to have: familiarity with spiritual care, religious or alternative belief communities, or the psychology of misinformation and conspiracy belief • Nice to have: prior experience evaluating, annotating or red teaming AI systems • Unable to support H1-B or STEM OPT candidates at this time

🏖️ Benefits

• W-2 employment with payroll, benefits, and compliance through Cincinnatus LLC • Payments weekly via Stripe or Wise based on services rendered • Fully remote work • Flexible own schedule • Opportunity to work with leading AI labs and researchers • Opportunity to help shape next-generation AI systems • Referral payments of up to $1,120 per successful referral, subject to limits