AI Benchmark Engineer, Native Language Specialist – Spanish

πŸ•’ September 8

πŸ—£οΈπŸ‡ͺπŸ‡Έ Spanish Required

Where this job comes from

Posted on LILT AI's careers page β†—LILT AI's careers page, not through a job board

First seen by Remote Rocketship September 8

Still open on LILT AI's site. Checked 2 hours ago.

Apply Now
Logo of LILT AI

LILT AI

201 - 500 employees

Founded 2015

πŸ€– Artificial Intelligence

☁️ SaaS

🏒 Enterprise

πŸ’° $25M Funding Round - LILT on 2025-06

Artificial Intelligence β€’ SaaS β€’ Enterprise

LILT AI is a multilingual AI platform that helps enterprises and public-sector organizations create, translate, verify, and manage content across languages at scale. It combines domain-specific AI models, continuous model training, and a human intelligence layer of professional linguists to deliver secure, brand-consistent localization, translation verification, and multilingual model development. The platform offers enterprise project management, 100+ native integrations, on-prem and air-gapped deployments, and tools to train, evaluate, and govern multilingual AI for use cases like website localization, product launches, technical documentation, and regulatory/compliance communications.

πŸ“‹ Description

β€’ Design, build, and validate Terminal-Bench benchmark tasks for multilingual software challenges β€’ Evaluate coding agents β€’ Build realistic task environments using datasets and files in Spanish β€’ Create prompts and translations in the target language to identify AI failure points β€’ Develop robust reference implementations β€’ Write reliable, deterministic verifier scripts β€’ Analyze execution logs and calibrate task difficulty from Easy to Very Hard β€’ Run standard Terminal-Bench configurations against Haiku, Sonnet, and Opus model tiers β€’ Participate in a four-layer human quality-control process: creation, human review, calibration review, and audit β€’ Work alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity

🎯 Requirements

β€’ 5+ years of industry experience in software engineering β€’ Proven track record at leading technology companies and/or graduation from top-tier engineering universities β€’ Native or near-native fluency in Spanish, with deep understanding of grammar, register, and phrasing rules β€’ High English proficiency β€’ Strong proficiency in Python, standard shell scripting, and data processing β€’ Extensive experience with Terminal/CLI-based development workflows β€’ Working familiarity with coding agents β€’ Deep technical understanding of multilingual text processing pitfalls β€’ Knowledge of encoding/decoding robustness and Unicode normalization β€’ Knowledge of locale-dependent conventions, including collation, casing, and non-Gregorian dates β€’ Knowledge of text I/O, toolchain interoperability, and safe string operations β€’ For specific languages, knowledge of bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts β€’ Reliable availability and commitment; most tasks require a minimum of 2 hours per day or 10 hours per week β€’ Ability to submit an updated CV in English β€’ Ability to complete a GenAI assessment β€’ As a 1099 contractor, responsibility for own tax obligations β€’ Contractors must not be located in regions subject to international embargoes or sanctions

πŸ–οΈ Benefits

β€’ Flexible schedule with no fixed hours, check-ins, or micromanaging β€’ Competitive rates β€’ Prompt payments β€’ Access to diverse, innovative projects β€’ Portfolio development and skill expansion β€’ Global community of linguists, subject matter experts, and language professionals β€’ No health insurance, paid time off, or retirement contributions are provided β€’ Supplemental income opportunity with fluctuating work availability

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ August 6

Anyone AI

11 - 50

πŸ“š Education

πŸ€– Artificial Intelligence

🎯 Recruiter

Chemistry expert creating deterministic training and evaluation problems for frontier AI models. Applying Python, computational chemistry, and rigorous scientific reasoning to produce verified solutions.

πŸ‡¦πŸ‡· Argentina – Remote

πŸ’΅ $40 / hour

πŸ’° $1.5M Pre Seed Round - Anyone AI on 2022-06

⏳ Contract/Temporary

🟑 Mid-level

🟠 Senior

πŸ€– Artificial Intelligence

πŸ•’ May 20

Terrific

11 - 50

πŸ›οΈ eCommerce

☁️ SaaS

🀝 B2B

CEO Projects / AI Operator focused on social commerce innovation at Terrific, leveraging AI for strategic problem-solving and operational projects.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok