Hospitalist, Internist – Medical AI Evaluation

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $36k - $72k / year

⏱ Part Time

⚪️ Entry-level

🤖 Artificial Intelligence

Where this job comes from

Posted on Mindrift's careers page, not through a job board

First seen by Remote Rocketship 0 minutes ago

Logo of Mindrift

Mindrift

501 - 1000 employees

🤖 Artificial Intelligence

🏪 Marketplace

☁️ SaaS

Artificial Intelligence • Marketplace • SaaS

Mindrift is a platform that connects skilled professional contributors and domain experts with AI training and evaluation projects run by leading technology companies. Part of Toloka, Mindrift recruits and vets freelancers—writers, editors, QA specialists, scientists, and subject-matter experts—to generate data, test model safety and reasoning, evaluate media quality, and build real-world scenarios that improve AI performance and reliability. It operates as a talent marketplace and platform for on-demand AI training, onboarding contributors through assessments and identity verification and offering flexible, paid project work.

📋 Description

• Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor “trap” answers across diagnosis and treatment tasks • Assess vignettes spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems • Score clinical reasoning quality, vignette accuracy and completeness, answer correctness and gradeability, and trap quality • Check whether reasoning chains reach answers from vignette facts alone • Correct reasoning traces and write short rationales • Participate in three independent blind reads followed by physician adjudication • Submit tasks by deadlines and meet acceptance criteria

🎯 Requirements

• US-based, actively practicing physician • Medical degree (MD or DO) • Active, unrestricted US medical license, verified with the issuing medical board • Board certification or completed residency training • Recent direct patient care; attending-level preferred • Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine • Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines • Strong written English (C1+) • CV must be submitted in English with English proficiency level indicated • Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare titles

🏖️ Benefits

• Project-based, part-time opportunity • Paid per accepted task • Effective rate up to the equivalent of $100/hr, depending on qualification tier and task efficiency • Flexible workload estimated at around 10–20 hours per week during active project phases

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 5

PTV Logistics

201 - 500

🚗 Transport

☁️ SaaS

📦 Logistics

Working Student supporting AI-driven solutions, CRM data quality, and analytics. Contributing to sales process optimization at PTV Logistics, a global transportation logistics software company.

🕒 September 3

Ancestry

1001 - 5000

💼 Consulting

🏥 Healthcare

📣 Marketing

Applied AI Co-op developing embedding, segmentation, and personalization models. Building scalable ML systems for Ancestry’s family-history discovery and recommendation experiences.

🕒 August 14

MyEmployment

11 - 50

👥 HR Tech

☁️ SaaS

🤝 B2B

AI operations intern building automation, dashboards, and knowledge systems for MyEmployment, which modernizes employment verification. Supporting scalable AI-powered workflows with the Technology Solutions team and startup executives.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok