Business Domain Expert – AI Model Evaluation Pilot, Admin, Marketing, HR, Accounting

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $70 - $100 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🧾 Accounting Manager

👻 Ghost score 0%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Mercor

Mercor

51 - 200 employees

Founded 2023

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

Mercor is a company for which no descriptive text was provided in the input. Additional information (products, services, target customers, or industry specifics) is needed to create an accurate summary and select appropriate industries.

📋 Description

• Complete one realistic, domain-specific task using provided source files • Review five model-generated attempts for the task • Rank the attempts from 1–5 without ties • Score each attempt from 0–100 • Write evidence-based rationales citing specific parts of each output • Provide structured feedback on the task and study design • Sign an NDA before receiving study materials • Participate in a one-time, short structured AI model evaluation pilot estimated at 8–12 hours

🎯 Requirements

• 5+ years of hands-on professional experience in Human Resources or Accounting • Currently or recently practicing in the relevant domain • Ability to write clear, specific, evidence-grounded rationales • Reliability within a short turnaround window • Must sign an NDA before receiving materials • Must not have worked on Project Alchemy in any capacity or accessed its source world data • Use of LLMs or other AI assistants is prohibited at every stage • Must be able to work as an independent contractor • H1-B and STEM OPT candidates are not supported

🏖️ Benefits

• Fully remote role with flexible self-scheduled work • Weekly payments via Stripe or Wise • Competitive pay • Opportunity to collaborate with leading researchers • Opportunity to help shape the next generation of AI systems • Referral program paying up to $400 per successful referral, with no limit on referrals (restrictions may apply) • Reasonable accommodations upon request

Apply Now

Similar Jobs

🕒 4 days ago

Aston Carter

1001 - 5000

🎯 Recruiter

💼 Consulting

🤝 B2B

Accounting AI Consultant evaluating and improving AI-generated accounting content for Aston Carter, a corporate talent solutions provider. Developing finance scenarios, checking technical accuracy, and guiding AI reasoning.

🕒 August 17

Weekday (YC W21)

11 - 50

💼 Consulting

👥 HR Tech

☁️ SaaS

Accounting professionals provide practical workflow insights for upcoming engagements with leading AI research organizations. Written intake informs accounting research, AI evaluations, and future project matching.

🕒 August 15

Weekday (YC W21)

11 - 50

💼 Consulting

👥 HR Tech

☁️ SaaS

Accounting Expert evaluating AI-generated and human accounting work for a client project. Creating rubrics and reviewing deliverables against US GAAP and professional standards.

🕒 August 8

Terac

1 - 10

🤖 Artificial Intelligence

🤝 B2B

Accounting professionals demonstrating complex QuickBooks workflows in Terac’s paid AI research study. Sharing screens, explaining workarounds, and discussing real-world accounting productivity.

🕒 July 28

Compose.ly

51 - 200

🤝 B2B

☁️ SaaS

📣 Marketing

B2B Thought Leadership Writer creating engaging and authoritative content for a global advisory and accounting firm. Collaborating with partners to develop original thought leadership articles across various industries.