Subject-Matter Experts – AI Benchmark Question Writers, Reviewers

🔥 23 minutes ago

🇹🇭 Thailand – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

✏️ Content Writer

👻 Ghost score 15%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

1-StopAsia

WebsiteLinkedInAll Job Openings

51 - 200 employees

🤝 B2B

💼 Consulting

B2B • Consulting

1-StopAsia is a one-stop source for all your Asian language needs. Since its inception in 1998, the company has continuously grown, providing translation services to over 700 LSP companies worldwide. They emphasize high-quality service and timely delivery for Asian language projects, with a focus on languages such as Chinese, Japanese, Korean, and Thai, largely through their in-house teams.

📋 Description

• Write original, exam-style questions in the native language and selected domain • Write short-form questions and long-form connected reasoning tasks graded against a rubric • Test each question on five AI models: GPT, Gemini, Claude Opus, Kimi and Muse Spark • Produce questions accepted when at least three of five models answer incorrectly • Write at least five non-challenge questions per domain that models answer correctly • Provide the correct answer, reasoning, explanation of difficulty and model errors for every question, translated into English • Record all work in a structured Google Sheets template • Review accepted questions against criteria covering form, ambiguity, multi-step reasoning, correctness and reasoning explanation • Comment on issues and approve or return questions

🎯 Requirements

• Native speaker of Thai, Filipino, Vietnamese, Korean or Russian • University degree in one of the listed domains (Master's or PhD preferred), and/or professional, teaching or research experience in it • Strong written English, enough to translate questions, answers and explanations accurately • Comfortable working with AI chat tools and Google Sheets • Precise, patient and able to work independently to a deadline • Exam or test-writing experience is nice to have • University teaching is nice to have • Expertise in more than one domain is nice to have • Prior work in AI training data, evaluation or annotation is nice to have • Able to complete all work by 2 November 2026 • For each covered domain, deliver 20 accepted questions (10 short-form and 10 long-form), plus at least 5 non-challenge questions

🏖️ Benefits

• Question Writers are paid in USD per accepted question, with a higher rate for long-form questions • Reviewers are paid per reviewed question or hourly • Flexible hours • Fully remote work • Opportunity to work on AI benchmark development and evaluation • Work may cover one or several domains • Start as soon as possible after onboarding