QA Engineer

Job not on LinkedIn

๐Ÿ•’ May 27

Where this job comes from

Posted on Titan AI's careers page โ†—Titan AI's careers page, not through a job board

First seen by Remote Rocketship May 27

Still open on Titan AI's site. Checked 3 hours ago.

Apply Now
Logo of Titan AI

Titan AI

1 - 10 employees

๐ŸŽฎ Gaming

๐Ÿฅฝ AR/VR

๐Ÿค– Artificial Intelligence

Gaming โ€ข AR/VR โ€ข Artificial Intelligence

Titan AI is a company focused on developing mobile role-playing games (RPGs) that incorporate artificial intelligence (AI) companions. Their first game, titled 'Hell Rush', is set to be released in July 2024.

๐Ÿ“‹ Description

โ€ข Titan builds AI software for banks: purpose-built small language models, a banking ontology, and AI bankers that financial institutions can trust. โ€ข You are coming in to do the work: write the test cases, build the evaluation framework, set up CI/CD gates, and triage bugs alongside engineering. โ€ข You personally design and execute the evaluation framework for LLM and agentic AI outputs across Foundry, Agent Builder, and client-deployed instances. โ€ข You write the assertions, define the behavioral contracts, and own regression baselines for model behavior. โ€ข You write and maintain the automated test suite: end-to-end, integration, and regression coverage for backend APIs, document ingestion pipelines, AI inference workflows, and frontend surfaces. โ€ข You produce the test artifacts, audit logs, and process documentation that meet SOC 2 Type II standards.

๐ŸŽฏ Requirements

โ€ข Seven or more years in software QA engineering, with at least two years personally testing AI or ML systems. โ€ข You have written test cases against LLM outputs, built evaluation pipelines from scratch, and know the difference between a flaky test and a genuinely non-deterministic system. โ€ข You are fluent in Python and have built automated suites using pytest, Playwright, or Selenium. โ€ข You have hands-on experience with RAGAS, DeepEval, LangSmith, or comparable evaluation toolingโ€”not just familiarity with the names. โ€ข You can trace a failure from the application layer to infrastructure and know enough about Azure, async systems, and REST APIs to do it without waiting on an engineer to walk you through it. โ€ข You have integrated QA gates into CI/CD pipelines and owned the process end to end. โ€ข Experience in fintech, banking, or another regulated environment is a strong advantage. โ€ข Familiarity with document processing pipelines, multi-agent architectures, RAG validation, or observability tooling such as Arize or Langfuse puts you ahead.

๐Ÿ–๏ธ Benefits

โ€ข Competitive base and meaningful equity. โ€ข Remote (US). Occasional travel to client sites and team offsites.

Apply Now

๐Ÿ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

๐Ÿ•’ May 19

FormativGroup

51 - 200

๐Ÿ’ผ Consulting

๐Ÿฅ Healthcare

๐Ÿ›ก๏ธ Insurance

Salesforce QA Engineer validating Government Cloud, Service Cloud, and Experience Cloud implementations. Supporting automated testing, integrations, and regulated public-sector technology delivery for FormativGroup.

๐Ÿ•’ May 7

TOPPAN Group

10,000+ employees

๐Ÿญ Manufacturing

๐Ÿ“ฆ Logistics

๐Ÿ“ฃ Marketing

Senior Quality Engineer overseeing quality systems and providing support to ensure compliance documentation. Managing supplier quality processes and leading audits with 50% travel.

๐Ÿ•’ May 1

NextGen IT Services

51 - 200

๐Ÿค B2B

๐Ÿข Enterprise

๐ŸŽฏ Recruiter

Contractor providing platform specific Quality Assurance expertise ensuring project completion and cost savings while reviewing key project processes and documentation.

๐Ÿ•’ April 30

Madrigal Pharmaceuticals

51 - 200

๐Ÿฅ Healthcare

๐Ÿ’Š Pharmaceuticals

๐Ÿงฌ Biotechnology

Senior Manager responsible for overseeing GCP Quality Assurance at Madrigal. Managing clinical trial compliance and quality systems in the biopharmaceutical industry.

๐Ÿ•’ April 22

Bloom Energy

1001 - 5000

๐Ÿฅ Healthcare

๐Ÿ“ฆ Logistics

๐Ÿ’ผ Consulting

Senior Staff Field Quality Engineer ensuring quality and reliability in Bloom Energyโ€™s installations. Supporting energy production platforms on-time and budget while meeting all established quality requirements.

Built byย Lior Neu-ner. I'd love to hear your feedback โ€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok