AI Benchmark Engineer, Native Language Specialist – Arabic

🔥 27 minutes ago

🇦🇪 United Arab Emirates (UAE) – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

LILT AI

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2015

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

💰 $25M Funding Round - LILT on 2025-06

Artificial Intelligence • SaaS • Enterprise

LILT AI is a multilingual AI platform that helps enterprises and public-sector organizations create, translate, verify, and manage content across languages at scale. It combines domain-specific AI models, continuous model training, and a human intelligence layer of professional linguists to deliver secure, brand-consistent localization, translation verification, and multilingual model development. The platform offers enterprise project management, 100+ native integrations, on-prem and air-gapped deployments, and tools to train, evaluate, and govern multilingual AI for use cases like website localization, product launches, technical documentation, and regulatory/compliance communications.

📋 Description

• Design, build, and validate Terminal-Bench tasks for multilingual software challenges • Evaluate coding agents • Build realistic task environments using datasets and files in Arabic, keeping assets in the target language • Find AI failure points through prompting and translation work in Arabic • Develop robust reference implementations • Write reliable, deterministic verifier scripts • Analyze execution logs and calibrate task difficulty from Easy to Very Hard • Run standard Terminal-Bench configurations against Haiku, Sonnet, and Opus model tiers • Participate in four-layer human quality control: creation, human review, calibration review, and audit • Work alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity • Support multilingual AI and human-verified language services for enterprises, governments, and AI developers

🎯 Requirements

• 5+ years of industry experience in software engineering • Proven track record at leading technology companies and/or graduation from top-tier engineering universities • Native or near-native fluency in Arabic with deep understanding of grammar, register, and phrasing rules • High English proficiency • Strong proficiency in Python, standard shell scripting, and data processing • Extensive experience with Terminal/CLI-based development workflows • Working familiarity with coding agents • Deep technical understanding of multilingual text-processing pitfalls • Experience with encoding/decoding robustness and Unicode normalization • Knowledge of locale-dependent conventions, including collation, casing, and non-Gregorian dates • Experience with text I/O, toolchain interoperability, and safe string operations • For Arabic: knowledge of bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts • Reliable availability and commitment to on-time delivery • Most tasks require availability of at least 2 hours per day or 15–20 hours per week • Ability to submit an updated CV in English • Must complete a GenAI assessment • Contractors cannot be engaged in regions subject to international embargoes or sanctions • Responsible for own tax obligations

🏖️ Benefits

• Flexible schedule; work when you want, as much or as little as you want • No fixed hours, check-ins, or micromanaging • Competitive rates • Prompt payments • Access to diverse, innovative projects • Portfolio-building and professional skill development across industries and domains • Global community of linguists, subject matter experts, and language professionals • Remote work from anywhere, any time you want • No health insurance, paid time off, or retirement contributions are provided • Hours are not guaranteed