Senior Software Development Engineer in Test – AI

🔥 12 hours ago

🌲 North Carolina – Remote

🌲 North Carolina – Remote

⏰ Full Time

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 11%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Anaplan

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2006

💼 Consulting

📦 Logistics

🏥 Healthcare

💰 Secondary Market on 2018-03

Consulting • Logistics • Healthcare

Anaplan is a leading provider of connected planning and business modeling solutions. The platform enables organizations to transform their decision-making processes using intelligent planning, data management, and predictive insights. Anaplan serves a diverse range of industries, including consumer goods, financial services, and manufacturing, by offering tailored solutions that enhance productivity and drive digital transformation. Recognized by Gartner, Forrester, and IDC, Anaplan is a trusted partner for enterprises looking to improve collaboration and gain a competitive edge through agile and comprehensive planning tools.

📋 Description

• Design and architect comprehensive test plans, evaluation frameworks, and quality metrics for LLM-powered applications and agentic workflows • Develop robust end-to-end automated test suites in Python across evaluations, API checks, UI checks, and performance tests • Create automated prompt testing systems and regression suites to detect unintended changes in model behavior • Establish evaluation criteria for GenAI quality across accuracy, relevance, safety, consistency, and latency • Perform adversarial testing (red-teaming) to identify and mitigate hallucinations, biases, and security vulnerabilities • Develop internal tools and testing frameworks for validating GenAI implementations • Deploy real-time monitoring and alerting systems to detect quality degradation in production AI features • Own the quality and testing strategy, maintain high-fidelity test datasets, and define QA best practices

🎯 Requirements

• Deep understanding of GenAI technologies, including LLMs, prompt engineering, and AI application patterns • Strong hands-on Python coding experience • Expert experience with test automation frameworks and scripting, including Python, JavaScript, Selenium, and Pytest • Strong background in software testing methodologies: functional, integration, regression, performance, and security testing • Proven ability to design test cases and evaluation criteria for non-deterministic systems • Strong analytical and problem-solving skills with attention to detail • Experience with API testing tools, including Postman and REST Assured, and backend testing • Strong experience with CI/CD pipelines and automated testing integration

🏖️ Benefits

• Inclusive culture focused on diversity, equity, inclusion and belonging • Reasonable accommodation for individuals with disabilities • Equitable benefits and all privileges of employment