Staff Applied AI Engineer – Product & Agent Performance

🕒 2 dias atrás

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $175.000 - $200.000 / ano

⏰ Tempo Integral

🔴 Especialista

🤖 Engenheiro de IA

🦅 Patrocina Visto H1B

Esta empresa já patrocinou vistos H1B no passado.

👻 Score fantasma 1%

O que significa: quão provável esta vaga está aberta sem contratação ativa.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Arcadia

SiteLinkedInTodas as Vagas

201 - 500 funcionários

🏥 Saúde

💼 Consultoria

💰 $29.500.000 Venture Round em 2020-01

Healthcare • Consulting

A Arcadia é dedicada a dias mais felizes e saudáveis para todos. Transformamos dados diversos em uma estrutura unificada para a saúde. Nossa plataforma oferece insights acionáveis para nossos clientes avançarem no cuidado e na pesquisa, impulsionarem o crescimento estratégico e alcançarem sucesso financeiro. Para mais informações, visite arcadia.io.

Descrição

• Design and iterate on agent behavior across real, live workflows, including long-horizon, multi-turn agentic tasks • Design retrieval and context architecture to keep agents grounded in real data • Design memory and state handling across multi-turn and multi-agent flows • Create context and prompt templates using few-shot examples, structured formatting, and reasoning scaffolding • Improve performance through prompting, tool-use strategy, and context construction • Build and run evaluations against real production conditions • Author evaluation rubrics, quality heuristics, and severity- and cost-weighted thresholds • Design and validate escalation paths to human review based on confidence and uncertainty • Optimize cost-aware performance alongside latency, reliability, and accuracy • Evaluate and sign off on model changes and make go/no-go launch decisions • Maintain product-level AI documentation, including model cards, intended use, limitations, and known failure modes • Partner with Product and product managers to make agents steerable, trustworthy, and ready to scale • Establish production-grounded baselines, document failure modes, and create measurement plans • Map retrieval, context, memory, and escalation patterns and identify reliability, calibration, and cost improvements • Turn production evidence into actionable recommendations for Product and Engineering

🎯 Requisitos

• Equivalent practical experience demonstrating the depth required for this staff-level role • 8+ years of production software engineering experience • 3+ years of hands-on ownership of ML, LLM, or agentic systems in production • Direct experience in healthcare, finance, or another regulated industry • Ability to diagnose why an agent failed and attribute fixes to instruction, retrieval, context, or memory design • Ability to weigh failures by severity and cost rather than frequency alone • Hands-on experience with RAG architecture • Experience with production-grounded evaluation frameworks • Experience with fallback or human-in-the-loop logic for automated systems • Working familiarity with AWS AI/ML services, including Bedrock and SageMaker • Experience applying AI to healthcare data or workflows where safety, transparency, and calibrated uncertainty affect care teams or patients (preferred) • Experience with long-horizon, multi-turn or multi-agent workflows and product-level AI documentation such as model cards (preferred)

🏖️ Benefícios

• The opportunity to define how agent performance, safety, and readiness are measured for production healthcare workflows • Meaningful ownership across prompts, context, memory, evaluations, and escalation patterns at product scale • A cross-functional role translating production evidence into AI improvements used across Arcadia’s platform • A mission-driven company working to improve how patients receive care • A flexible, remote-friendly culture with personality and heart • Employee-driven programs and initiatives for personal and professional development • Membership in the talented, energized, diverse, and purpose-driven Arcadian community