AI Agentic Tester

Job not on LinkedIn

🔥 9 minutes ago

🏰 Missouri – Remote

🏰 Missouri – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Delan Associates Inc.

WebsiteLinkedInAll Job Openings

51 - 200 employees

🎖️ Defense

📦 Logistics

💼 Consulting

Defense • Logistics • Consulting

Delan Associates Inc. is a professional services and engineering firm, founded in 2002, that provides training, systems engineering, facilities maintenance, acquisition support, and general management services primarily to U. S. government and military customers. The company supports multiple U. S. Army schools with instructor and training services, has provided facilities maintenance and logistics support for operations such as Afghanistan and U. S. Central Command, and offers network and systems engineering expertise including SIPR/NIPR implementations. DAI is an SBA 8(a) certified Small Disadvantaged Business and partners with established defense and government contractors.

📋 Description

• Perform functional testing of AI agent workflows and end-to-end AI applications. • Validate LLM responses for accuracy, relevance, consistency, and hallucination rates. • Test RAG pipelines, prompt engineering, and AI agent orchestration. • Execute API testing using Postman, Swagger, and REST APIs. • Develop and maintain automation scripts using Python, Selenium, Playwright, or PyTest. • Validate multi-agent interactions, tool calling, and workflow execution. • Apply AI testing methodologies and evaluation metrics to ensure response quality. • Work with Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms to validate AI solutions.

🎯 Requirements

• AI Agentic Testing • Functional Testing • Generative AI Testing • Large Language Models (LLMs) • AI Agents & Agentic AI • Retrieval-Augmented Generation (RAG) • Prompt Engineering Validation • AI Model Validation & Evaluation • API Testing (Postman, REST APIs, Swagger) • Python • Test Automation (Selenium / Playwright / PyTest) • AI Evaluation Metrics (Accuracy, Hallucination, Relevance, Consistency) • End-to-End Workflow Testing • Multi-Agent Testing • Azure OpenAI / AWS Bedrock / Gemini