Lead QA Engineer

Vaga não está no LinkedIn

🕒 Maio 27

Candidatar-se

Encontrar Vagas Remotas Similares

Receber Emails de Vagas Remotas

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo

Titan AI

SiteLinkedInTodas as Vagas

1 - 10 funcionários

Construindo jogos de RPG móvel com Companheiros ✨ de IA 🤖. Primeiro jogo: Hell Rush será lançado em julho de 2024.

Descrição

• Design and execute the evaluation framework for LLM and agentic AI outputs. • Write the assertions, define the behavioral contracts, and own regression baselines for model behavior. • Write and maintain the automated test suite for backend APIs and frontend surfaces. • Own performance and load testing for latency-sensitive inference paths. • Produce test artifacts, audit logs, and process documentation that meet SOC 2 Type II standards. • Work directly with Forward Deployed Engineering on client-side validation and production issue reproduction.

🎯 Requisitos

• Seven or more years in software QA engineering, with at least two years personally testing AI or ML systems. • Fluency in Python and experience building automated suites using pytest, Playwright, or Selenium. • Hands-on experience with RAGAS, DeepEval, LangSmith, or comparable evaluation tooling. • Ability to trace a failure from the application layer to infrastructure. • Integrated QA gates into CI/CD pipelines and owned the process end to end. • Experience in fintech, banking, or another regulated environment is a strong advantage. • Familiarity with document processing pipelines, multi-agent architectures, RAG validation, or observability tooling such as Arize or Langfuse.

🏖️ Benefícios

• Competitive base and meaningful equity. • Remote (US). Occasional travel to client sites and team offsites.