LLMOps Engineer

Emploi pas sur LinkedIn

🕒 il y a 3 jours

Postuler Maintenant

Trouver des Emplois à Distance Similaires

Configurer une alerte email pour les nouveaux emplois

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Télécharger le CV

The Disruptors Den

Site WebLinkedInTous les Emplois

51 - 200 employés

Fondée en 2023

🤝 B2B

🌍 Impact social

B2B • Startup • Social Impact

The Disruptors Den est une organisation centrée sur l'innovation et l'entrepreneuriat, offrant une plateforme permettant aux startups et aux nouvelles idées de prospérer. Elle sert de communauté pour les perturbateurs et les visionnaires cherchant à défier le statu quo et à impulser des changements dans leurs secteurs respectifs. L'objectif de The Disruptors Den est de connecter des individus partageant cette vision et de favoriser un environnement propice à la croissance et à la collaboration.

Description

• Build and run product-specific evaluation suites by failure mode, on schedule and with every release • Maintain cost-effective evaluations as the product line grows • Own the reporting loop by presenting evaluation findings and platform data to the team and stakeholders • Surface unintended or problematic model behaviour before learners encounter it • Steward core datasets, including classified customer-support data • Partner with the AI Product Manager on product instrumentation and build evaluations over captured data • Collaborate with Anthropic Engineers, AI engineers, product managers, and data scientists to design learning experiences • Grow from supporting the technical lead’s designs toward full ownership of the analyzer function

🎯 Exigences

• Solid Python skills and comfort shaping and analysing messy LLM-generated data • Data inclination • Ability to decompose AI products into success and failure metrics • Familiarity with Langfuse, RAGAS, DSPy, or similar evaluation tools; depth in one and awareness of the others • Evidence of measuring an AI system honestly in a project • Willingness to own a function rather than only execute tickets • Strong communication and collaboration ability • Self-drive to communicate constantly using web collaboration and video conferencing • Preferred time zone: GMT+2 • Desirable but not required: experience keeping evaluations cheap at scale, dashboarding and reporting, and classical statistics

🏖️ Avantages

• Encouraged to continually develop capability and attain certifications to reflect individual growth • Virtual working and collaboration across international locations