AI Implementation Quality Analyst

🕒 Junho 11

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $80.000 - $105.700 / ano

⏰ Tempo Integral

🟡 Pleno

🟠 Sênior

🤖 Inteligência Artificial

🦅 Patrocina Visto H1B

Esta empresa já patrocinou vistos H1B no passado.

👻 Score fantasma 19%

O que significa: quão provável esta vaga está aberta sem contratação ativa.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Configurar Alerta de Email para Novas Vagas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Granicus

SiteLinkedInTodas as Vagas

501 - 1000 funcionários

Fundada em 1999

🏛️ Governo

☁️ SaaS

📋 Conformidade

Government • SaaS • Compliance

A Granicus é uma empresa de tecnologia focada no governo que fornece uma Government Experience Cloud e uma gama de serviços digitais para agências locais, estaduais, federais, de educação e de distritos especiais. Seus produtos incluem plataformas de engajamento e comunicação, nuvens de serviço e operações (para licenças, registros, solicitações de serviço/311), gerenciamento de reuniões e agendas, sites/CMS, ferramentas de conformidade e um Agente de Experiência do Governo com tecnologia AI para oferecer autoatendimento 24 horas por dia, 7 dias por semana. A Granicus ajuda organizações do setor público a modernizar a prestação de serviços, aumentar o engajamento dos cidadãos, automatizar fluxos de trabalho e melhorar a eficiência operacional.

Descrição

• Partner directly with clients during implementation to understand use cases, success criteria, and risk tolerance • Translate client requirements into evaluation frameworks, prompt strategies, and test coverage • Act as the quality liaison between client, product, and engineering to ensure alignment pre- and post-launch • Review and score AI responses using standard rubrics • Validate against sources/ground truth; flag hallucinations, omissions, and other risks • Document findings and calibrate with peers to keep scoring consistent • Build and maintain prompt banks and golden sets (expected results) • Expand coverage for edge cases, high-risk scenarios, and real user language • Track regression/drift and feed dashboards and quality reports • Triage internal and client feedback; synthesize themes across deployments • Identify systemic risks and escalate high-impact findings with clear, client-relevant context • Partner with product/engineering to validate and verify fixes, ensuring alignment with client expectations

🎯 Requisitos

• Strong analytical judgment and attention to detail • Excellent written communication skills, including the ability to explain reasoning clearly • Experience reviewing, auditing, or evaluating structured outputs such as content, decisions, or recommendations • Comfort applying detailed guidelines and rubrics consistently at scale • Familiarity with large language models and common failure modes such as hallucinations, overgeneralization, or unsafe responses • Ability to work in spreadsheets, evaluation tools, or annotation platforms • Experience with AI evaluation, data annotation, QA, trust and safety, or policy review • Exposure to human-in-the-loop workflows, or benchmarking processes • Domain expertise in a regulated or high-risk field such as government, education, healthcare, or legal services • Experience contributing to test suites, evaluation dashboards, or quality reporting • Comfort working cross-functionally with product and engineering teams • Experience in client-facing roles such as implementation, consulting, or solution delivery in a SaaS or regulated environment • Ability to translate between business/user needs and technical system behavior.

🏖️ Benefícios

• Flexible Time Off – Take the time you need to rest, recharge, and live your life. • Company-Wide Wellbeing Days – Paid days off to unplug and focus on your mental health. • Work From Home Reimbursement – Support a productive home office environment. • Multiple Health Plan Options – Including a 100% employer-paid plan. • Employer HSA Contributions – When enrolled in a High-Deductible Health Plan. • Fitness Reimbursement Program – Stay active, your way. • On-Demand Mental Health Support – Access to Headspace and other wellness tools. • Paid Parental Leave – For both birthing and non-birthing parents. • Traditional & Roth 401(k) – With a generous company match. • Life & AD&D Insurance – 100% employer-paid coverage for peace of mind. • Online Learning Platforms – Fuel your professional development. • Competitive Salary & Bonuses – Your contributions are valued and rewarded.