AI Test Engineer

Job not on LinkedIn

🔥 3 hours ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

CluePoints

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2012

🏥 Healthcare

🤖 Artificial Intelligence

☁️ SaaS

💰 Private Equity Round - CluePoints on 2020-08

Healthcare • Artificial Intelligence • SaaS

CluePoints is a clinical-trial focused software company that applies advanced statistics, machine learning, and AI to risk-based quality management (RBQM) and data oversight. Their platform offers products such as RBQM, Site Profile & Oversight Tool (SPOT), Medical & Safety Review (MSR), Intelligent Medical Coding, and Intelligent Query Detection (IQD) to detect anomalies, automate coding and query detection, and help sponsors, CROs, and study teams monitor and de-risk clinical studies across phases. CluePoints positions itself as an AI-powered SaaS provider that turns trial data into actionable insights to improve trial quality and regulatory readiness.

📋 Description

• Designing and executing comprehensive test strategies specifically for AI-powered features within the application. • Validating AI outputs for accuracy, consistency, edge-case handling, and alignment with business requirements. • Designing prompt-based and scenario-driven tests to evaluate model behavior, under varied inputs. • Defining measurable validation criteria for non-deterministic systems (confidence ranges, tolerance thresholds, expected behavior patterns). • Collaborating with engineering and product teams to improve explainability, observability, and traceability of AI decisions. • Ensuring AI features meet quality, compliance, and audit requirements where applicable. • Leveraging AI coding assistants (e.g., GitHub Copilot, Codex, or similar tools) to accelerate test development and framework enhancement. • Using AI tools to generate high-quality test scenarios from requirements and user stories. • Reviewing, validating, and refining AI-generated test code to ensure accuracy, scalability, and maintainability. • Contributing to AI-driven test design patterns and reusable automation strategies. • Promoting AI-augmented productivity practices within the QA team. • Designing, developing, and maintaining scalable Playwright-based automation frameworks for UI, API, and end-to-end testing. • Integrating automated test suites into CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, etc.). • Performing exploratory testing to uncover edge cases, usability gaps, and unexpected system behavior.

🎯 Requirements

• Experience testing AI-driven or data-driven systems (LLMs, ML models, rule engines, recommendation systems, NLP-based features, etc.). • Understanding of AI/ML behavior concepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling. • Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail). • Strong hands-on experience with Playwright automation framework. • Proficiency in JavaScript or TypeScript. • Demonstrated expertise using GitHub Copilot, Codex, or AI coding assistants as part of daily development workflow. • Solid understanding of automation framework architecture and design patterns. • (nice to have) • Regulatory experience in the pharmaceuticals (clinical trials), Insurance / Banking / Fintech (advantageous)

🏖️ Benefits

• Private Medical Insurance through Vitality Health (full hospital cover, 24/7 GP, and therapy sessions) • Group Critical Illness Cover with Aviva • Life Insurance (death-in-service lump sum) • Pension Scheme with 9% employer contribution via Scottish Widows • Opportunities for professional development and sponsored certifications • A hub-based hybrid model that blends flexibility with purpose — connecting teams through collaboration, learning, and a vibrant social culture.