Search Remote Jobs

AI Benchmark Engineer, Native Language Specialist – Chinese

🕒 September 24

🇭🇰 Hong Kong – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🗣️🇨🇳 Chinese Required

Where this job comes from

Posted on LILT AI's careers page, not through a job board

First seen by Remote Rocketship September 24

Still open on LILT AI's site. Checked 4 hours ago.

Logo of LILT AI

LILT AI

201 - 500 employees

Founded 2015

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

💰 $25M Funding Round - LILT on 2025-06

Artificial Intelligence • SaaS • Enterprise

LILT AI is a multilingual AI platform that helps enterprises and public-sector organizations create, translate, verify, and manage content across languages at scale. It combines domain-specific AI models, continuous model training, and a human intelligence layer of professional linguists to deliver secure, brand-consistent localization, translation verification, and multilingual model development. The platform offers enterprise project management, 100+ native integrations, on-prem and air-gapped deployments, and tools to train, evaluate, and govern multilingual AI for use cases like website localization, product launches, technical documentation, and regulatory/compliance communications.

📋 Description

• Design, build, and validate Terminal-Bench tasks for multilingual software challenges • Evaluate coding agents • Build realistic task environments using datasets and files in Chinese • Keep benchmark assets in the target language to measure multilingual handling • Find AI failure points through prompting and translation in the native language • Support robust reference implementations • Write reliable, deterministic verifier scripts • Analyze execution logs and calibrate task difficulty from Easy to Very Hard • Run standard Terminal-Bench configurations against Haiku, Sonnet, and Opus model tiers • Participate in a four-layer human quality-control process covering creation, human review, calibration review, and audit • Work alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity

🎯 Requirements

• 5+ years of industry experience in software engineering • Proven track record at leading technology companies and/or graduation from top-tier engineering universities • Native or near-native fluency in Chinese, with deep understanding of grammar, register, and phrasing rules • High English proficiency • Strong proficiency in Python, standard shell scripting, and data processing • Extensive experience with Terminal/CLI-based development workflows • Working familiarity with coding agents • Deep technical understanding of multilingual text processing pitfalls • Knowledge of encoding/decoding robustness and Unicode normalization • Knowledge of locale-dependent conventions, including collation, casing, and non-Gregorian dates • Knowledge of text I/O, toolchain interoperability, and safe string operations • For applicable languages, knowledge of bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts • Reliable availability and commitment • Ability to complete accepted tasks on time • Most tasks require availability of at least 2 hours per day or 15–20 hours per week • CV must be submitted in English • Geographic restrictions may apply due to international embargoes or sanctions

🏖️ Benefits

• Independent contractor schedule with no fixed hours, check-ins, or micromanaging • Competitive rates • Prompt payments • Access to diverse, innovative projects • Portfolio and skills development across industries and domains • Flexible work from anywhere, any time • Global community of linguists, subject matter experts, and language professionals • No health insurance, paid time off, or retirement contributions are provided • Hours are not guaranteed • Supplemental-income opportunity with fluctuating work availability

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 July 27

Hupo

11 - 50

🤖 Artificial Intelligence

☁️ SaaS

🛡️ Insurance

Practitioner Contributor utilizing AI in sales, providing feedback and critique on insurance and wealth scenarios. Remote role focusing on enhancing the sales coaching experience through real field insights.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok