Business Domain Expert – AI Model Evaluation, Admin, Marketing, HR, Accounting

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $60 - $80 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🧾 Accounting Manager

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Mercor

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2023

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

Mercor is a company for which no descriptive text was provided in the input. Additional information (products, services, target customers, or industry specifics) is needed to create an accurate summary and select appropriate industries.

📋 Description

• Complete one realistic, domain-specific professional task using provided source files • Review five AI model-generated attempts at the same task • Rank the attempts from 1–5 with no ties • Score each attempt from 0–100 • Write evidence-based rationales citing specific parts of each output • Provide structured feedback on the task and study design • Sign an NDA before receiving study materials • Participate in a one-time evaluation pilot measuring frontier AI model performance and professional judgment

🎯 Requirements

• 5+ years of hands-on professional experience in Admin / Business Operations, Marketing, Human Resources, or Accounting • Currently or recently practicing in the relevant domain • Ability to write clear, specific, evidence-grounded rationales • Reliability within a short turnaround window • Must sign an NDA before receiving materials • Must not have worked on Project Alchemy in any capacity or accessed its source world data • Use of LLMs or other AI assistants is prohibited at every stage • Must be engaged as an independent contractor • Must be legally able to work without H1-B or STEM OPT support

🏖️ Benefits

• Fully remote role with flexible own schedule • Weekly payments via Stripe or Wise • Competitive pay • Opportunity to collaborate with leading researchers • Opportunity to help shape the next generation of AI systems • Up to $320 for each successful referral; no limit on referrals (restrictions may apply) • Reasonable accommodations upon request