Healthcare Subject Matter Expert – AI Model Evaluation

🔥 0 minutes ago

🌐 Canada, United States, +5 more countries – Remote

infoinfo

💵 $15 - $35 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 3%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Volga Partners

Volga Partners

1001 - 5000 employees

Founded 2020

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Volga Partners is a technology services firm that specializes in Artificial Intelligence and Machine Learning solutions, data annotation and labeling, and development of customer service platforms powered by generative AI. The company also provides IT and software development services across web, app, full-stack, cybersecurity advisory, and e-commerce support, supported by a large multilingual crowd workforce and remote on-demand resources. Volga Partners focuses on partnering with enterprise clients to deliver scalable, cost-effective AI tooling, content moderation, linguistic services, and managed software projects.

📋 Description

• Review AI-generated healthcare information for factual accuracy, completeness, clinical relevance, and consistency with medical knowledge and guidelines • Evaluate AI-generated assessments, differential diagnoses, and treatment-related explanations • Identify factual errors, unsupported assumptions, missing clinical considerations, and potential patient safety concerns • Validate information using peer-reviewed medical literature, clinical practice guidelines, and established healthcare resources • Analyze hypothetical patient cases, symptoms, medical histories, laboratory findings, and diagnostic information • Provide evidence-based feedback and recommend appropriate corrections • Follow project-specific scoring rubrics, annotation instructions, and quality assurance guidelines • Complete independent evaluation tasks using designated online platforms, including DataCompute • Meet established deadlines and quality expectations • Protect sensitive project information and comply with privacy, ethical, and data security requirements

🎯 Requirements

• Current enrollment in the third or fourth year of a recognized medical degree program, an eligible medical internship or residency, or an advanced NP or PA educational program with relevant clinical training • Relevant academic coursework, clinical rotations, or supervised training in General Practice, Family Medicine, Internal Medicine, Nurse Practitioner practice, or Physician Assistant practice • Second-year medical students must be enrolled at a top medical school • Strong understanding of medical terminology, anatomy, physiology, pathology, pharmacology, and relevant clinical concepts • Ability to assess medical scenarios, interpret clinical information, and distinguish evidence-based reasoning from inaccurate or unsupported conclusions • Ability to research medical literature, interpret clinical guidelines, and validate findings using authoritative healthcare resources • Strong analytical reasoning, problem-solving abilities, and attention to detail • Excellent written English skills • Comfort working with computers, web-based platforms, digital documentation, and online research tools • Ability to follow detailed instructions, complete assignments independently, and meet quality requirements • Willingness to participate in a remote, freelance engagement with project-dependent assignments and schedules • Independent medical licensure and previous employment as a licensed physician, Nurse Practitioner, or Physician Assistant are not required • Qualified applicants may be required to complete a medical knowledge or clinical reasoning assessment

🏖️ Benefits

• Project-based hourly compensation • Remote work from an eligible location • Flexible, variable schedule with potential weekday and weekend assignments • Exposure to AI evaluation, medical content assessment, and evidence-based research • Opportunity to apply medical education and clinical reasoning to healthcare AI projects

Apply Now

Similar Jobs

🕒 October 9

TELUS Technology

201 - 500

💼 Consulting

📣 Marketing

📡 Telecommunications

Business Logic Expert reviewing AI-generated business content for professional accuracy and etiquette. Helping TELUS Digital improve AI systems through remote, flexible freelance work.

🕒 September 30

UNESCO

1001 - 5000

📚 Education

🤝 Non-profit

🌍 Social Impact

UNESCO consultant analyzing learning assessment data with AI-assisted methods. Developing policy insights, reproducible protocols, and national analyst capacity.

🕒 September 30

Valtech

5001 - 10000

💼 Consulting

📣 Marketing

☁️ SaaS

AI Enablement Lead building Valtech’s AI-native training strategy and curriculum. Measuring workforce enablement across its experience innovation consultancy.

🕒 September 8

LILT AI

201 - 500

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

AI benchmark engineer building French-Canadian Terminal-Bench coding evaluations for LILT. Creating multilingual datasets, prompts, reference implementations, and verifier scripts for AI models.

🇨🇦 Canada – Remote

💰 $25M Funding Round - LILT on 2025-06

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🗣️🇫🇷 French Required

🕒 August 14

Welo Global

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Generative AI Analyst validating Canadian French translations for Welo Data, a global AI data company. Reviewing and annotating multilingual AI-generated content for training and quality improvement.

🗣️🇫🇷 French Required