Lead QA Engineer

Job not on LinkedIn

🕒 May 27

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Titan AI

WebsiteLinkedInAll Job Openings

1 - 10 employees

Building mobile RPG Games with AI ✨ Companions 🤖. First game: Hell Rush is coming in July 2024.

📋 Description

• Design and execute the evaluation framework for LLM and agentic AI outputs. • Write the assertions, define the behavioral contracts, and own regression baselines for model behavior. • Write and maintain the automated test suite for backend APIs and frontend surfaces. • Own performance and load testing for latency-sensitive inference paths. • Produce test artifacts, audit logs, and process documentation that meet SOC 2 Type II standards. • Work directly with Forward Deployed Engineering on client-side validation and production issue reproduction.

🎯 Requirements

• Seven or more years in software QA engineering, with at least two years personally testing AI or ML systems. • Fluency in Python and experience building automated suites using pytest, Playwright, or Selenium. • Hands-on experience with RAGAS, DeepEval, LangSmith, or comparable evaluation tooling. • Ability to trace a failure from the application layer to infrastructure. • Integrated QA gates into CI/CD pipelines and owned the process end to end. • Experience in fintech, banking, or another regulated environment is a strong advantage. • Familiarity with document processing pipelines, multi-agent architectures, RAG validation, or observability tooling such as Arize or Langfuse.

🏖️ Benefits

• Competitive base and meaningful equity. • Remote (US). Occasional travel to client sites and team offsites.