AI Benchmark Engineer – Native Language Specialist, German

Likely ghost job

πŸ•’ February 26

πŸ—£οΈπŸ‡©πŸ‡ͺ German Required

Where this job comes from

Posted on LILT AI's careers page β†—LILT AI's careers page, not through a job board

First seen by Remote Rocketship February 26

Still open on LILT AI's site. Checked 4 hours ago.

Apply Now
Logo of LILT AI

LILT AI

201 - 500 employees

Founded 2015

πŸ€– Artificial Intelligence

☁️ SaaS

🏒 Enterprise

πŸ”₯ Funding within the last year

πŸ’° $25M Funding Round - LILT on 2025-06

Artificial Intelligence β€’ SaaS β€’ Enterprise

LILT AI is a multilingual AI platform that helps enterprises and public-sector organizations create, translate, verify, and manage content across languages at scale. It combines domain-specific AI models, continuous model training, and a human intelligence layer of professional linguists to deliver secure, brand-consistent localization, translation verification, and multilingual model development. The platform offers enterprise project management, 100+ native integrations, on-prem and air-gapped deployments, and tools to train, evaluate, and govern multilingual AI for use cases like website localization, product launches, technical documentation, and regulatory/compliance communications.

πŸ“‹ Description

β€’ Task Engineering: Evaluating Coding Agents. β€’ Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. β€’ Prompting & Translation: finding failure points where AI does not work, in your native language. β€’ Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). β€’ Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). β€’ Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.

🎯 Requirements

β€’ 5+ years of industry experience in software engineering. β€’ Proven track record at leading technology companies and/or graduation from top-tier engineering universities. β€’ Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. β€’ Strong proficiency in Python, standard shell scripting, and data processing. β€’ Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. β€’ Deep technical understanding of multilingual text processing pitfalls, including: β€’ Encoding/decoding robustness and Unicode normalization. β€’ Locale-dependent conventions (collation, casing, non-Gregorian dates). β€’ Text I/O, toolchain interoperability, and safe string operations. β€’ *(For specific languages)* Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.

πŸ–οΈ Benefits

β€’ Note this is a remote, freelance opportunity β€’ Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive communityβ€”all through a streamlined application process tailored to your expertise.

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok