Korean AI Model Rater

Job not on LinkedIn

Yesterday

Apply Now

Receive Emails with Similar Jobs

Productive Playhouse

WebsiteLinkedInAll Job Openings

eCommerce • Media • Security

Productive Playhouse is an international language services company committed to offering precise and culturally authentic linguistic experiences. The company provides a wide range of services including transcription, translation, localization, linguistic services, and large language model validation with a human-in-the-loop approach. With a global presence and support in over 300 languages and locales, Productive Playhouse also ensures security with cleanroom facilities and security certifications like 27001 and SOC II. Their services cater to both remote and on-site needs, with extensive facilities across the US and internationally.

201 - 500 employees

🛍️ eCommerce

📱 Media

🔐 Security

📋 Description

• Analyze and rate AI-generated responses and their associated tool outputs against a detailed set of quality guidelines. • Verify that the AI successfully integrates information from different digital services (APIs) as required by the prompt. • Evaluate the accuracy, completeness, and overall quality of the AI's response and tool execution. • Follow provided instructions to achieve task goals, with all evaluations recorded in English.

🎯 Requirements

• Advanced/Expert fluency in Korean language, as spoken in the South Korea region • Strong comprehension of English (read and write) • Strong conceptual knowledge of APIs and digital services • Ability to follow complex technical guidelines precisely. • All participants must have, or be willing to create, an Upwork account. • Must pass a quick skill verification assessment (MC, duration ~10 minutes). • Work must be performed on participant’s own devices. • Must have a Gmail account or create one.

🏖️ Benefits

• Flexible schedule