Senior AI Engineer

🔥 0 minutes ago

🌐 United Kingdom, Netherlands, +4 more countries – Remote

🇬🇧 United Kingdom – Remote 🇳🇱 Netherlands – Remote 🇮🇪 Ireland – Remote 🇷🇴 Romania – Remote 🇵🇱 Poland – Remote 🇵🇹 Portugal – Remote

⏰ Full Time

🟠 Senior

🤖 AI Engineer

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

RWS Group

WebsiteLinkedInAll Job Openings

5001 - 10000 employees

💼 Consulting

🏥 Healthcare

⚖️ Legal

Consulting • Healthcare • Legal

RWS Group is a leading provider of AI-powered language services and technology, specializing in translation and localization for a variety of industries. With a focus on enhancing global communication, RWS offers solutions that improve translation quality, manage multilingual content, and streamline the localization process. Their services cater to sectors such as aerospace, finance, legal, life sciences, and technology, leveraging advanced AI to ensure clients can effectively connect across languages and cultures.

📋 Description

• Design and architect core platform components and evaluation systems • Make technical decisions and maintain accountability for reliability, scalability, and long-term maintainability • Set technical direction for building, evaluating, and deploying AI capabilities across the company • Define a scalable platform vision beyond the immediate team • Design reusable abstractions, SDKs, and services for model integration, prompt management, experimentation, and deployment • Define company-wide AI evaluation strategies and methodologies, including automated metrics, human-in-the-loop workflows, test-set management, and benchmarking • Build production-ready evaluation frameworks and developer tooling • Establish AI observability standards for quality, performance, cost, and regression signals • Build dashboards and reporting that turn signals into actionable decisions • Drive testing discipline, reproducibility, sound experimental design, and statistically defensible model-quality measurement • Provide technical leadership on ambiguous, high-impact problems • Mentor engineers and raise standards through code and design reviews • Contribute to model and system governance, documentation, dataset and test-set versioning, reproducibility, and responsible-AI checks • Codify best practices into tooling and standards adopted by hundreds of developers • Track LLM, evaluation research, and AI tooling developments • Prototype, de-risk, and shepherd emerging techniques from experiment to supported platform capability • Champion adoption of new platform capabilities across teams • Partner with research, product, and localization leaders to align evaluation with customer needs • Influence roadmap and technical strategy across engineering and product stakeholders • Gather developer requirements and represent them in platform direction • Communicate technical direction, trade-offs, and quality standards to technical and non-technical audiences

🎯 Requirements

• Significant software engineering experience, typically 5+ years, building and operating production systems, tools, libraries, or services used by many engineers • Excellent API design, reliability, and developer experience • Experience with CI/CD and cloud infrastructure • Proficiency in Python and/or another general-purpose language • Strong testing discipline • Hands-on experience building with LLMs or other ML systems, including prompt engineering, fine-tuning, retrieval, or model integration • Understanding of LLM/ML failure modes and tradeoffs • Proven experience designing and leading evaluation for AI/ML systems • Experience defining metrics and methodology, building evaluation pipelines, managing test sets, and rigorously assessing model quality and regressions • Strong command of accuracy, precision, recall, F1, automated evaluation, human evaluation, statistical significance, and methodological limitations • Excellent written and verbal communication • History of influencing technical direction across teams and mentoring engineers • Comfort with ambiguity and ability to scope, prioritize, and sequence high-impact work with limited direction • Preferred: experience evaluating NLP, machine translation, or content-generation systems using COMET, chrF++, BLEU, MetricX, or MQM-style human evaluation • Preferred: experimentation and observability tooling, data/test-set versioning, and rigorous benchmarking workflows • Preferred: AI governance and documentation including model cards, system cards, reproducibility, and responsible-AI considerations • Preferred: familiarity with modern LLM ecosystems, orchestration frameworks, and vector stores • Preferred: experience supporting multilingual or localization-focused enterprise products

🏖️ Benefits

• Equal employment opportunity and inclusive, discrimination-free work environment • Opportunities to grow as an individual and excel in your career • Work with global teams and experts in AI, data, content, language, and localization