AI Benchmark Engineer, Native Language Specialist – French

πŸ•’ September 8

πŸ‡¨πŸ‡¦ Canada – Remote

⏳ Contract/Temporary

🟑 Mid-level

🟠 Senior

πŸ€– Artificial Intelligence

πŸ—£οΈπŸ‡«πŸ‡· French Required

Where this job comes from

Posted on LILT AI's careers page β†—LILT AI's careers page, not through a job board

First seen by Remote Rocketship September 8

Still open on LILT AI's site. Checked 0 minutes ago.

Apply Now
Logo of LILT AI

LILT AI

201 - 500 employees

Founded 2015

πŸ€– Artificial Intelligence

☁️ SaaS

🏒 Enterprise

πŸ’° $25M Funding Round - LILT on 2025-06

Artificial Intelligence β€’ SaaS β€’ Enterprise

LILT AI is a multilingual AI platform that helps enterprises and public-sector organizations create, translate, verify, and manage content across languages at scale. It combines domain-specific AI models, continuous model training, and a human intelligence layer of professional linguists to deliver secure, brand-consistent localization, translation verification, and multilingual model development. The platform offers enterprise project management, 100+ native integrations, on-prem and air-gapped deployments, and tools to train, evaluate, and govern multilingual AI for use cases like website localization, product launches, technical documentation, and regulatory/compliance communications.

πŸ“‹ Description

β€’ Design, build, and validate Terminal-Bench tasks for multilingual software challenges β€’ Evaluate coding agents β€’ Build realistic task environments using datasets and files in French β€’ Create prompts and translations in the native language to identify AI failure points β€’ Develop robust reference implementations β€’ Write reliable, deterministic verifier scripts β€’ Analyze execution logs and calibrate task difficulty from Easy to Very Hard β€’ Run standard Terminal-Bench configurations against Haiku, Sonnet, and Opus model tiers β€’ Participate in a four-layer human quality-control process: creation, human review, calibration review, and audit β€’ Work alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity

🎯 Requirements

β€’ 5+ years of industry experience in software engineering β€’ Proven track record at leading technology companies and/or graduation from top-tier engineering universities β€’ Native or near-native fluency in French, with deep understanding of grammar, register, and phrasing rules β€’ High English proficiency β€’ Strong proficiency in Python β€’ Strong proficiency in standard shell scripting β€’ Strong proficiency in data processing β€’ Extensive experience with Terminal/CLI-based development workflows β€’ Working familiarity with coding agents β€’ Deep technical understanding of multilingual text processing pitfalls β€’ Knowledge of encoding/decoding robustness and Unicode normalization β€’ Knowledge of locale-dependent conventions, including collation, casing, and non-Gregorian dates β€’ Knowledge of text I/O, toolchain interoperability, and safe string operations β€’ For specific languages, knowledge of bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts β€’ Reliable availability and commitment to on-time delivery β€’ Updated CV in English β€’ Successful completion of a GenAI assessment

πŸ–οΈ Benefits

β€’ Flexible schedule with no fixed hours, check-ins, or micromanaging β€’ Competitive rates β€’ Prompt payments β€’ Access to diverse, innovative projects β€’ Portfolio and skills development opportunities β€’ Global community of linguists, subject matter experts, and language professionals β€’ No health insurance, paid time off, or retirement contributions are provided β€’ Hours are not guaranteed β€’ Most tasks require a minimum of 2 hours per day or 10 hours per week

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok