AI Agent Evaluator

🕒 il y a 2 mois

🇺🇸 États-Unis – Télétravail

⏳ Contrat

🟡 Intermédiaire

🟠 Senior

🤖 Intelligence Artificielle

👻 Score fantôme 42%

infoinfo

🗣️🇺🇸🇬🇧 Anglais requis

Postuler Maintenant
Trouver des Emplois à Distance Similaires

📊 Vérifiez votre score de CV pour ce poste

Améliorez vos chances d'obtenir un entretien en vérifiant votre score de CV avant de postuler.

Logo of Hippocratic AI

Hippocratic AI

11 - 50 employés

Fondée en 2023

🤖 Intelligence artificielle

⚕️ Assurance santé

🏥 Santé

💰 €50 000 000 Seed Round en 2023-05

Artificial Intelligence • Healthcare Insurance • Healthcare

Hippocratic AI est une entreprise innovante de technologie de santé spécialisée dans les solutions basées sur l'intelligence artificielle, conçues pour améliorer les soins aux patients et la prise de décision clinique. Leurs produits tirent parti de l'analyse avancée des données et de l'apprentissage automatique pour soutenir les prestataires de santé, améliorant ainsi l'efficacité et la précision des pratiques médicales. En intégrant une technologie de pointe en matière d'IA dans les processus de santé, Hippocratic AI vise à révolutionner le domaine médical, améliorant ultimement les résultats pour les patients et les praticiens.

Description

• Evaluate recorded and simulated AI agent interactions involving acute symptom triage and assess escalation and de-escalation decisions • Review agent conversations related to insulin and diabetes medication titration for clinical accuracy and guideline adherence • Evaluate agent-delivered travel health guidance, including pre-travel counseling, vaccination recommendations, and destination-specific risk assessment • Identify clinical safety concerns, edge cases, and gaps in triage logic or clinical reasoning • Score and annotate agent performance using structured evaluation rubrics • Provide actionable written feedback to clinical and product teams to inform agent refinement • Participate in case review and calibration sessions with other clinical SMEs • Help develop and refine test scenarios for ongoing agent quality assurance

🎯 Exigences

• Registered Nurses: active, unrestricted RN License • Nurse Practitioners: active, unrestricted Nurse Practitioner license in the United States, with current board certification (ANCC or AANP) • Minimum of 5+ years of direct clinical experience in primary care, urgent care, telephone/virtual triage, or a comparable acute-care setting • Clinical experience managing patients with diabetes, including insulin titration • Strong, current working knowledge of relevant triage protocols and clinical practice guidelines • Ability to critically evaluate clinical reasoning and identify inaccuracies or safety risks in written or recorded clinical interactions • Comfortable working independently in a remote, asynchronous contract role • Strong written communication skills for delivering structured clinical feedback • Experience in telephone triage or nurse advice line settings (recommended) • Experience in travel medicine, occupational health, or pre-travel consultation (recommended) • Familiarity with CDC and other travel medicine guidelines (recommended) • Prior experience in clinical quality assurance, utilization review, or case review (recommended) • Familiarity with AI-assisted clinical tools or digital health platforms (recommended)

🏖️ Avantages

• Fully remote work • Flexible scheduling • Hourly compensation commensurate with experience

Postuler Maintenant

Emplois Similaires

🕒 il y a 2 mois

DevFixr

2 - 10

🎯 Recrutement

🤝 B2B

💼 Conseil

AI Trainer creating realistic, unambiguous software engineering tasks for frontier language model training. Evaluating model performance across Python and other programming-language environments.

🇺🇸 États-Unis – Télétravail

⏳ Contrat

🟡 Intermédiaire

🟠 Senior

🤖 Intelligence Artificielle

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 mois

Welo Global

1001 - 5000

🤖 Intelligence artificielle

🤝 B2B

☁️ SaaS

Generative AI Analyst annotating text, image, audio, and video data for Welo Data’s AI training systems. Supporting quality checks and dataset development for multilingual AI projects.

🇺🇸 États-Unis – Télétravail

💵 $15 / heure

⏳ Contrat

🟡 Intermédiaire

🟠 Senior

🤖 Intelligence Artificielle

🗣️🇺🇸🇬🇧 Anglais requis

🗣️🇨🇳 Chinois requis

🕒 il y a 2 mois

Sunshine Enterprise USA

51 - 200

🎯 Recrutement

👥 RH Tech

🤝 B2B

AI Consultant leading enterprise AI initiatives focused on evaluating, designing, and implementing AI solutions. Collaborating with stakeholders and ensuring compliance with governance and security standards.

🇺🇸 États-Unis – Télétravail

⏳ Contrat

🟡 Intermédiaire

🟠 Senior

🤖 Intelligence Artificielle

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 mois

Welo Global

1001 - 5000

🤖 Intelligence artificielle

🤝 B2B

☁️ SaaS

Generative AI Analyst supporting AI projects by reviewing and annotating content across media types. Collaborate in a global community to enhance the development of advanced AI systems.

🇺🇸 États-Unis – Télétravail

💵 $15 / heure

⏳ Contrat

🟡 Intermédiaire

🟠 Senior

🤖 Intelligence Artificielle

🗣️🇺🇸🇬🇧 Anglais requis

🕒 il y a 2 mois

Benchmark Insurance Group

2 - 10

🛡️ Assurance

🤝 B2B

AI Workflow Architect designing and building automation systems for insurance and real estate operations. Deploying end-to-end AI workflows and collaborating with leadership to optimize processes.

🇺🇸 États-Unis – Télétravail

⏳ Contrat

🟡 Intermédiaire

🟠 Senior

🤖 Intelligence Artificielle

🗣️🇺🇸🇬🇧 Anglais requis