QA Engineer

Job not on LinkedIn

🕒 May 27

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🔧 QA Engineer (Quality Assurance)

Azure

Python

Selenium

Where this job comes from

Posted on Titan AI's careers page ↗Titan AI's careers page, not through a job board

First seen by Remote Rocketship May 27

Still open on Titan AI's site. Checked 54 minutes ago.

Apply Now
Logo of Titan AI

Titan AI

1 - 10 employees

🎮 Gaming

🥽 AR/VR

🤖 Artificial Intelligence

Gaming • AR/VR • Artificial Intelligence

Titan AI is a company focused on developing mobile role-playing games (RPGs) that incorporate artificial intelligence (AI) companions. Their first game, titled 'Hell Rush', is set to be released in July 2024.

📋 Description

• Titan builds AI software for banks: purpose-built small language models, a banking ontology, and AI bankers that financial institutions can trust. • You are coming in to do the work: write the test cases, build the evaluation framework, set up CI/CD gates, and triage bugs alongside engineering. • You personally design and execute the evaluation framework for LLM and agentic AI outputs across Foundry, Agent Builder, and client-deployed instances. • You write the assertions, define the behavioral contracts, and own regression baselines for model behavior. • You write and maintain the automated test suite: end-to-end, integration, and regression coverage for backend APIs, document ingestion pipelines, AI inference workflows, and frontend surfaces. • You produce the test artifacts, audit logs, and process documentation that meet SOC 2 Type II standards.

🎯 Requirements

• Seven or more years in software QA engineering, with at least two years personally testing AI or ML systems. • You have written test cases against LLM outputs, built evaluation pipelines from scratch, and know the difference between a flaky test and a genuinely non-deterministic system. • You are fluent in Python and have built automated suites using pytest, Playwright, or Selenium. • You have hands-on experience with RAGAS, DeepEval, LangSmith, or comparable evaluation tooling—not just familiarity with the names. • You can trace a failure from the application layer to infrastructure and know enough about Azure, async systems, and REST APIs to do it without waiting on an engineer to walk you through it. • You have integrated QA gates into CI/CD pipelines and owned the process end to end. • Experience in fintech, banking, or another regulated environment is a strong advantage. • Familiarity with document processing pipelines, multi-agent architectures, RAG validation, or observability tooling such as Arize or Langfuse puts you ahead.

🏖️ Benefits

• Competitive base and meaningful equity. • Remote (US). Occasional travel to client sites and team offsites.

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 May 26

Fortrea

10,000+ employees

🏥 Healthcare

🧬 Biotechnology

💊 Pharmaceuticals

Executive Director of Clinical Pharmacology Services Quality Assurance providing leadership and oversight in QA and regulatory compliance for Fortrea's services. Ensuring robust quality management aligned with global regulations and business strategy.

🇺🇸 United States – Remote

💵 $220k - $245k / year

⏰ Full Time

🔴 Lead

🔧 QA Engineer (Quality Assurance)

🕒 May 21

rockITdata

11 - 50

🤖 Artificial Intelligence

💼 Consulting

Integration Tester tasked with validating integrations across AWS services within a FedRAMP High environment. Ensuring reliable function of real-time data pipelines and monitoring components.

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

🕒 May 19

FormativGroup

51 - 200

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Salesforce QA Engineer validating Government Cloud, Service Cloud, and Experience Cloud implementations. Supporting automated testing, integrations, and regulated public-sector technology delivery for FormativGroup.

🇺🇸 United States – Remote

💵 $115k - $155k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

🕒 May 18

KIS Solutions

51 - 200

💼 Consulting

📣 Marketing

📦 Logistics

Product Engineer focusing on data-driven and international projects within KIS Solutions. Conducting requirements gathering, prototyping solutions, and ensuring quality through testing.

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

🕒 May 18

Papa Johns

10,000+ employees

🏨 Hospitality

👥 B2C

🍽️ Food & Beverage

Senior QE Test Coordinator managing end-to-end testing for Papa John’s eCommerce, POS, payments, and loyalty platforms. Coordinating UAT, vendor capacity, defect management, and release readiness.

🗣️🇪🇸 Spanish Required

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok