AI Policy Generalist

🔥 16 hours ago

🇺🇸 United States – Remote

💵 $45 - $55 / hour

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Handshake

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2014

💼 Consulting

🏥 Healthcare

📦 Logistics

Consulting • Healthcare • Logistics

Handshake is a platform that connects students with potential employers and career centers, offering tools to streamline the recruiting process for its users. It provides features such as job postings, talent engagement suites, and event management for both virtual and in-person recruiting events. Handshake is widely used by Fortune 100 companies and offers integrations with existing automated tracking systems. It aims to build early career networks and supports a diverse range of Gen Z talent with a focus on improving hiring outcomes through proprietary data and advanced recruiting strategies.

📋 Description

• Learn customer policies, definitions, taxonomies, and evaluation rubrics • Evaluate user requests and AI model responses within full conversation context • Classify cases according to the most applicable policy category • Distinguish closely related labels, severity levels, and policy boundaries • Select defensible classifications for ambiguous cases • Write concise, evidence-based rationales citing policy language and conversation details • Identify policy gaps, contradictions, unclear definitions, and emerging edge cases • Raise questions when guidance does not resolve a case • Participate in calibration discussions with evaluators, project leads, policy teams, and researchers • Apply customer policies consistently without substituting personal beliefs • Maintain accuracy and attention to detail across repeated evaluations • Incorporate feedback and apply clarified guidance • Help improve evaluation frameworks, examples, decision rules, and quality standards • Move between projects covering different policy domains and customer needs

🎯 Requirements

• Must be based in the United States • Must be authorized to work lawfully in the United States for Handshake • Must be able to work Monday–Friday from 8AM–5PM PT as core hours • Ability to engage carefully, responsibly, and sustainably with sensitive material, including sexual content, emotional distress, self-harm, suicide, violence, weapons, abuse, exploitation, and discrimination • Sound judgment and consistent work quality • Ability to learn unfamiliar subject matter quickly • Ability to communicate clearly and precisely in writing • Ability to apply detailed policies, definitions, taxonomies, rubrics, and evaluation frameworks • Ability to distinguish closely related labels, severity levels, and policy boundaries • Ability to write concise, evidence-based rationales • Ability to participate in calibration discussions and incorporate feedback • Prior AI evaluation experience is helpful but not required • Strong candidates may come from quality assurance, research, editing, law, teaching, operations, trust and safety, content moderation, social science, policy, investigations, compliance, or customer support

🏖️ Benefits

• W-2 employment classification • Monday–Friday schedule • Core hours of 8AM–5PM PT • Remote work arrangement