Senior AI Engineer, Quality & Knowledge

🔥 59 minutes ago

Where this job comes from

Posted on PayFit's careers page ↗PayFit's careers page, not through a job board

First seen by Remote Rocketship 59 minutes ago

Still open on PayFit's site. Checked 18 minutes ago.

Apply Now
Logo of PayFit

PayFit

501 - 1000 employees

Founded 2015

👥 HR Tech

☁️ SaaS

🤝 B2B

💰 Secondary Market - PayFit on 2022-08

HR Tech • SaaS • B2B

PayFit is a cloud-based payroll and HR software company that automates payroll processing and streamlines HR management for small and medium-sized businesses. The platform simplifies complex payroll and HR tasks, supports employee lifecycle and benefits administration, and emphasizes a user-friendly experience and workplace culture. Founded in 2015 and operating across France, Spain and the UK, PayFit combines SaaS delivery with HR-focused tools to help businesses scale and manage people operations more efficiently.

📋 Description

• Work with Customer Support and payroll experts to understand complex cases and turn expertise into testable AI behavior • Build and improve evaluations using representative cases, expert reviews, and production feedback • Assess answers, actions, and workflow outcomes • Investigate failures across models, context, knowledge, retrieval, and tools • Implement and measure improvements • Contribute to specialized agents, orchestration, and harness engineering • Manage context, reusable tools, guardrails, and human handoffs • Improve knowledge pipelines and retrieval quality • Use regression evaluations and observability to keep workflows reliable as they evolve • Build user-facing LLM experiences for PayFit AI

🎯 Requirements

• 7+ years of software engineering experience • Experience designing and operating backend services or pipelines in production • Hands-on experience building LLM applications or agents, including tool integration, context management, and handling uncertainty • Experience evaluating LLM systems using representative datasets, clear criteria, and automated or human review • Strong backend engineering skills • Ability to contribute to a TypeScript/Node.js codebase • Ability to work directly with domain experts and translate ambiguous cases into testable behavior • Care for security, permissions, observability, and maintainability • Background check will verify identity, diploma, and past professional experience after the offer • Nice to have: experience with Langfuse or similar tools • Nice to have: familiarity with AI SDK or comparable agent frameworks • Nice to have: experience with hybrid search, reranking, OpenSearch, or search and vector technologies • Nice to have: experience measuring judge agreement, evaluation uncertainty, or agent consistency • Nice to have: experience building annotation tools or review workflows • Nice to have: familiarity with AWS, data pipelines, and CI/CD for AI systems • Nice to have: experience in payroll, HR, customer support, or another accuracy- and traceability-sensitive domain

🏖️ Benefits

• Possibility to work away from main offices within France and abroad for a defined period • Comprehensive learning platform supported by PayFit • Career development opportunities and internal moves • Henner Mutuelle Insurance, 60% covered by PayFit, with free coverage for children • 50% of public transportation costs covered for those living within the Ile de France region, or sustainable mobility assistance • Swile restaurant card (€9 per workday), covered at 60% by PayFit • Monthly Work Council allowance for culture, sports, personal services, plus a vacation bonus • MacBook as standard working tool • Salary maintenance during the first month of additional parental leave • 25 days of holidays + RTT days, depending on the contract • Disability accommodation measures during working conditions and recruitment

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 29

Scalian

5001 - 10000

💼 Consulting

🚀 Aerospace

🎖️ Defense

Ingénieur Qualité Senior pilotant audits, KPI et non-conformités pour les projets nucléaires de SCALIAN. Contribution au management qualité sur le site de Marcoule.

🗣️🇫🇷 French Required

🕒 June 16

Baker Hughes

10,000+ employees

🏭 Manufacturing

💼 Consulting

📦 Logistics

Ingénieur(e) Qualité Fournisseurs pour l'industrie nucléaire chez Baker Hughes. Évaluant la conformité et la performance des fournisseurs pour les composants critiques aux applications nucléaires.

🗣️🇫🇷 French Required

🕒 March 31

Fabulous

51 - 200

🏥 Healthcare

💼 Consulting

📣 Marketing

QA Engineer ensuring quality for popular health and wellness mobile apps with millions of users globally. Collaborating with teams and managing QA processes for mobile app releases.

🕒 February 2

Diabolocom

51 - 200

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Senior QA Engineer developing test automation strategies for AI-first cloud-native contact center. Collaborating with a diverse engineering team to ensure high-quality deployments.

🕒 February 2

Diabolocom

51 - 200

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Senior QA Engineer for developing automated tests in an AI-first contact center infrastructure. Involves challenging designs and ensuring quality through automation practices in a collaborative environment.

🗣️🇫🇷 French Required

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok