Healthcare Subject Matter Expert – AI Model Evaluation

🔥 1 hour ago

🌐 United States, United Kingdom, +5 more countries – Remote

infoinfo

💵 $45 - $160 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 3%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Volga Partners

Volga Partners

1001 - 5000 employees

Founded 2020

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Volga Partners is a technology services firm that specializes in Artificial Intelligence and Machine Learning solutions, data annotation and labeling, and development of customer service platforms powered by generative AI. The company also provides IT and software development services across web, app, full-stack, cybersecurity advisory, and e-commerce support, supported by a large multilingual crowd workforce and remote on-demand resources. Volga Partners focuses on partnering with enterprise clients to deliver scalable, cost-effective AI tooling, content moderation, linguistic services, and managed software projects.

📋 Description

• Evaluate AI-generated medical content for clinical accuracy, completeness, relevance, and consistency with accepted medical standards • Analyze AI-generated clinical reasoning, assessments, differential diagnoses, and treatment recommendations • Identify inaccurate medical information, unsupported conclusions, missing clinical considerations, and patient safety concerns • Validate medical information against authoritative literature, clinical guidelines, and evidence-based healthcare practices • Provide expert feedback and clinically appropriate corrections • Apply evaluation guidelines, scoring criteria, and project-specific quality standards • Complete independent evaluations using designated online platforms within project timelines • Help improve the accuracy, reliability, and healthcare reasoning of AI systems

🎯 Requirements

• Minimum of three years of relevant professional clinical experience in an applicable specialty • Recognized medical degree, advanced-practice qualification, or equivalent professional credential appropriate to the specialty and country • Demonstrated experience applying clinical judgment, diagnostic reasoning, or evidence-based medical practices • Strong understanding of medical terminology, clinical guidelines, and healthcare standards relevant to the candidate's specialization • Ability to critically evaluate complex medical information and distinguish accurate clinical reasoning from unsupported conclusions • Strong analytical, research, and problem-solving abilities • Excellent written English communication skills • Comfort using digital platforms, web-based applications, and online research tools • Ability to work independently, follow detailed instructions, and meet established quality standards • Must be comfortable with a task-based role • Physicians, nurse practitioners, and physician assistants sought • Current or previous professional licensure or registration relevant to the specialty preferred • Familiarity with U.S. healthcare standards or clinical practices in the United Kingdom, Canada, Australia, or New Zealand preferred • AI model evaluation, large language models, research, or structured quality assessment experience beneficial but not required

🏖️ Benefits

• Remote work from an eligible location • Project-based freelance work • Flexible, variable scheduling including potential weekday and weekend assignments • Opportunity to contribute to advanced AI model evaluation • No AI background required • Supplemental-income opportunity

Apply Now

Similar Jobs

🔥 14 hours ago

Pado

1 - 10

🤖 Artificial Intelligence

⚡ Energy

☁️ SaaS

Reserved GPU deal broker matching AI compute supply and demand for PADO’s LG-backed marketplace. Structuring pricing, margins, contracts, and capacity commitments for AI-native buyers.

🔥 21 hours ago

Mercor

51 - 200

AI red-team contractor probing Mercor partner models for jailbreaks, bias, and vulnerabilities. Generating structured human data to improve AI safety and reliability.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 21 hours ago

Mercor

51 - 200

AI Safety Specialist evaluating English conversations and AI responses. Providing structured feedback to help Mercor train and enhance frontier AI systems.

🇺🇸 United States – Remote

💵 $30 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 21 hours ago

Mercor

51 - 200

AI safety specialist evaluating English conversations and labeling AI responses. Supporting Mercor’s partnerships with AI labs to train and enhance frontier models.

🇺🇸 United States – Remote

💵 $30 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 21 hours ago

Mercor

51 - 200

AI safety red-teamer probing frontier models for jailbreaks, bias, and vulnerabilities at Mercor. Generating structured human data, attack cases, and reproducible safety reports.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence