
5001 - 10000 employees
💼 Consulting
🏥 Healthcare
⚖️ Legal
Consulting • Healthcare • Legal
RWS Group is a leading provider of AI-powered language services and technology, specializing in translation and localization for a variety of industries. With a focus on enhancing global communication, RWS offers solutions that improve translation quality, manage multilingual content, and streamline the localization process. Their services cater to sectors such as aerospace, finance, legal, life sciences, and technology, leveraging advanced AI to ensure clients can effectively connect across languages and cultures.
🔥 1 minute ago
🌐 Czechia, Poland, +1 more countries – Remote
⏰ Full Time
🟡 Mid-level
🟠 Senior
🧠 AI Research Scientist
👻 Ghost score 11%
Where this job comes from
Posted on RWS Group's careers page, not through a job board
First seen by Remote Rocketship 1 minute ago

5001 - 10000 employees
💼 Consulting
🏥 Healthcare
⚖️ Legal
Consulting • Healthcare • Legal
RWS Group is a leading provider of AI-powered language services and technology, specializing in translation and localization for a variety of industries. With a focus on enhancing global communication, RWS offers solutions that improve translation quality, manage multilingual content, and streamline the localization process. Their services cater to sectors such as aerospace, finance, legal, life sciences, and technology, leveraging advanced AI to ensure clients can effectively connect across languages and cultures.
• Design, build, and maintain automated execution pipelines for continuous LLM benchmarking across diverse languages, tasks, and models • Develop and roll out LLM-assisted pre-annotation and quality assurance pipelines for production data annotation • Implement and refine LLM-as-a-judge pipelines, custom evaluation metrics, and scoring algorithms • Build experiment infrastructure, datasets, and execution pipelines for multilingual LLM research studies and thought leadership reports • Translate applied NLP research into scalable prototypes and integrate research tools into production operations with the data engineering team • Collaborate on research findings, benchmark reports, and thought leadership publications • Prototype emerging AI capabilities including agentic AI evaluation, synthetic data quality certification, and domain-specific LLM assessment • Maintain documentation, code bases, and technical guides for evaluation frameworks and tools
• Master’s degree (MSc or equivalent) in Computer Science, Artificial Intelligence, Computational Linguistics, or a related technical field • 3–5+ years of hands-on experience in NLP or ML engineering • Advanced proficiency in Python and deep learning/NLP frameworks, including PyTorch or TensorFlow and Hugging Face transformers • Proven experience with LLM orchestration frameworks such as LangChain or LlamaIndex • Experience with automated evaluation techniques such as LLM-as-a-judge and benchmarking harnesses • Expertise in data manipulation, structured evaluation data processing, and analysis using pandas, NumPy, or related tools • Practical experience deploying and managing ML workflows on Azure, AWS, or Vertex AI • Experience building scalable data or experiment orchestration pipelines • Familiarity with multilingual NLP, machine translation, or computational linguistics • Knowledge of localization workflows, annotation platforms, or human-in-the-loop data pipelines • Track record of contributing to open-source NLP projects, evaluation frameworks, or published technical benchmarks
• Equal opportunity employment and a work environment free of discrimination and harassment • Opportunities to grow as an individual and excel in their career • Inclusive workplace valuing diversity
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.