QA Engineer

Stelle nicht auf LinkedIn

🕒 vor 2 Monaten

Jetzt Bewerben

Ähnliche Remote-Jobs finden

E-Mail-Benachrichtigung für neue Jobs einrichten

📊 Überprüfen Sie Ihre Lebenslauf-Bewertung für diese Stelle

Verbessern Sie Ihre Chancen auf ein Vorstellungsgespräch, indem Sie Ihre Lebenslauf-Bewertung vor der Bewerbung überprüfen.

Lebenslauf hochladen

Titan AI

WebsiteLinkedInAlle Stellen

1 - 10 Mitarbeiter

🎮 Gaming

🥽 AR/VR

🤖 Künstliche Intelligenz

Gaming • AR/VR • Artificial Intelligence

Entwicklung von mobilen RPG-Spielen mit KI ✨ Begleitern 🤖. Erstes Spiel: Hell Rush erscheint im Juli 2024.

Beschreibung

• Titan builds AI software for banks: purpose-built small language models, a banking ontology, and AI bankers that financial institutions can trust. • You are coming in to do the work: write the test cases, build the evaluation framework, set up CI/CD gates, and triage bugs alongside engineering. • You personally design and execute the evaluation framework for LLM and agentic AI outputs across Foundry, Agent Builder, and client-deployed instances. • You write the assertions, define the behavioral contracts, and own regression baselines for model behavior. • You write and maintain the automated test suite: end-to-end, integration, and regression coverage for backend APIs, document ingestion pipelines, AI inference workflows, and frontend surfaces. • You produce the test artifacts, audit logs, and process documentation that meet SOC 2 Type II standards.

🎯 Anforderungen

• Seven or more years in software QA engineering, with at least two years personally testing AI or ML systems. • You have written test cases against LLM outputs, built evaluation pipelines from scratch, and know the difference between a flaky test and a genuinely non-deterministic system. • You are fluent in Python and have built automated suites using pytest, Playwright, or Selenium. • You have hands-on experience with RAGAS, DeepEval, LangSmith, or comparable evaluation tooling—not just familiarity with the names. • You can trace a failure from the application layer to infrastructure and know enough about Azure, async systems, and REST APIs to do it without waiting on an engineer to walk you through it. • You have integrated QA gates into CI/CD pipelines and owned the process end to end. • Experience in fintech, banking, or another regulated environment is a strong advantage. • Familiarity with document processing pipelines, multi-agent architectures, RAG validation, or observability tooling such as Arize or Langfuse puts you ahead.

🏖️ Vorteile

• Competitive base and meaningful equity. • Remote (US). Occasional travel to client sites and team offsites.