Senior/Staff QA Engineer – Agentic AI Platform

Job not on LinkedIn

🔥 0 minutes ago

🏄 California, Illinois, +1 more states – Remote

🏄 California – Remote 🌽 Illinois – Remote 🗽 New York – Remote

💵 $80 - $90 / hour

⏳ Contract/Temporary

🟠 Senior

🔧 QA Engineer (Quality Assurance)

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Ontrac Solutions

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2010

🤖 Artificial Intelligence

💼 Consulting

🤝 B2B

Artificial Intelligence • Consulting • B2B

Ontrac Solutions is an AI-first technology services firm that helps organizations design, implement, and scale AI-driven systems, cloud architectures, and enterprise platform integrations. They provide AI strategy and generative AI implementation (including RAG and intelligent search), cloud migration and optimization (multi-cloud architecture, Kubernetes, Terraform, GitOps, and FinOps), data and integration engineering, CRM/CMS/e-commerce platform development, and embedded technical talent / staff augmentation to move AI from experimentation into production. With innovation hubs in Chicago and Karachi, Ontrac focuses on delivering production-ready AI and cloud solutions that drive measurable business outcomes.

📋 Description

• Support a critical customer engagement as a Senior/Staff QA Engineer. • Own quality end-to-end for a fast-moving agentic AI product. • Work closely with the Delivery Lead/Solutions Architect and customer engineering stakeholders to ensure product quality from initial test planning through final release.

🎯 Requirements

• 5+ years of professional QA experience, with at least 2+ years at a senior or staff level. • Demonstrated experience testing production software through a full Application Development Lifecycle (ADLC). • Strong understanding of the Application Development Lifecycle — from requirements through release and support. • Solid UI/UX understanding, with the ability to evaluate usability and flag design/interaction issues, not just functional bugs. • Hands-on experience testing AI Agent use cases — including conversational flows, agent decision-making, tool/function calling, and edge-case or failure-mode behavior. • Proven experience with automated testing frameworks and building maintainable, scalable test suites. • Ability to stand up and manage a Playwright cluster to run automated end-to-end (E2E) testing against a live agent platform. • Ability to independently define clear, well-structured test cases from ambiguous or evolving product requirements. • Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, and sign-off. • Deep expertise with Playwright (including cluster management and parallel execution). • Proficiency in JavaScript / TypeScript or Python for writing automation scripts. • Familiarity with testing LLM outputs, prompt evaluation frameworks, or conversational AI testing tools. • Experience integrating automated test suites into pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization. • Proficiency with Git, Jira, and modern test management tools.