AI Benchmark Engineer, Native Language Specialist – Portuguese (Brazil)

πŸ•’ September 8

πŸ—£οΈπŸ‡§πŸ‡·πŸ‡΅πŸ‡Ή Portuguese Required

Where this job comes from

Posted on LILT AI's careers page β†—LILT AI's careers page, not through a job board

First seen by Remote Rocketship September 8

Still open on LILT AI's site. Checked 3 hours ago.

Apply Now
Logo of LILT AI

LILT AI

201 - 500 employees

Founded 2015

πŸ€– Artificial Intelligence

☁️ SaaS

🏒 Enterprise

πŸ’° $25M Funding Round - LILT on 2025-06

Artificial Intelligence β€’ SaaS β€’ Enterprise

LILT AI is a multilingual AI platform that helps enterprises and public-sector organizations create, translate, verify, and manage content across languages at scale. It combines domain-specific AI models, continuous model training, and a human intelligence layer of professional linguists to deliver secure, brand-consistent localization, translation verification, and multilingual model development. The platform offers enterprise project management, 100+ native integrations, on-prem and air-gapped deployments, and tools to train, evaluate, and govern multilingual AI for use cases like website localization, product launches, technical documentation, and regulatory/compliance communications.

πŸ“‹ Description

β€’ Design, build, and validate Terminal-Bench tasks evaluating coding agents β€’ Build realistic task environments using datasets and files in Portuguese, keeping assets in the target language β€’ Find AI failure points through prompting and translation in Portuguese β€’ Develop robust reference implementations β€’ Write reliable, deterministic verifier scripts, using rubric-based judging only when strictly necessary β€’ Analyze execution logs and calibrate task difficulty from Easy to Very Hard β€’ Run standard Terminal-Bench configurations against Haiku, Sonnet, and Opus model tiers β€’ Participate in a four-layer human quality-control process covering creation, human review, calibration review, and audit β€’ Work alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity

🎯 Requirements

β€’ 1+ years of industry experience in software or prompt engineering β€’ Proven track record at leading technology companies and/or graduation from top-tier engineering universities β€’ Native or near-native Portuguese (Brazil) fluency with deep understanding of grammar, register, and phrasing rules β€’ High English proficiency β€’ Strong proficiency in Python, standard shell scripting, and data processing β€’ Extensive experience with Terminal/CLI-based development workflows β€’ Working familiarity with coding agents β€’ Deep technical understanding of multilingual text processing pitfalls β€’ Experience with encoding/decoding robustness and Unicode normalization β€’ Knowledge of locale-dependent conventions, including collation, casing, and non-Gregorian dates β€’ Knowledge of text I/O, toolchain interoperability, and safe string operations β€’ Updated CV in English β€’ Must complete a GenAI assessment β€’ Reliable availability and commitment; most tasks require at least 2 hours per day or 10 hours per week β€’ Contractors cannot be engaged in regions subject to international embargoes or sanctions β€’ Contractors are responsible for their own tax obligations

πŸ–οΈ Benefits

β€’ Flexible schedule with no fixed hours, check-ins, or micromanaging β€’ Competitive rates and prompt payments β€’ Access to diverse, innovative projects that expand your portfolio and sharpen your skills β€’ Global community of linguists, subject matter experts, and language professionals β€’ No benefits such as health insurance, paid time off, or retirement contributions are provided β€’ Work availability fluctuates with project demand and hours are not guaranteed

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ August 5

Welo Global

1001 - 5000

πŸ€– Artificial Intelligence

🀝 B2B

☁️ SaaS

Generative AI Analyst reviewing Portuguese AI content for Welo Data’s global AI training systems. Annotating multimedia data and performing quality checks to improve advanced AI datasets.

πŸ—£οΈπŸ‡§πŸ‡·πŸ‡΅πŸ‡Ή Portuguese Required

πŸ•’ March 20

Invisible Technologies

201 - 500

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Portuguese Language Specialist contributing to AI Training via phonetics, syntax and semantics. Involves linguistic analysis, error tracking, and prompt engineering improvements.

πŸ‡§πŸ‡· Brazil – Remote

πŸ”₯ Funding within the last year

πŸ’° $100M Series unknown on 2025-10

⏳ Contract/Temporary

βšͺ️ Entry-level

🟒 Junior

🟑 Mid-level

πŸ€– Artificial Intelligence

πŸ—£οΈπŸ‡§πŸ‡·πŸ‡΅πŸ‡Ή Portuguese Required

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok