
501 - 1000 employees
Founded 2011
🔒 Cybersecurity
☁️ SaaS
🏢 Enterprise
💰 Private Equity Round - Keeper Security on 2023-05
Cybersecurity • SaaS • Enterprise
Keeper Security, Inc. is a cybersecurity company that delivers cloud-first, zero-trust privileged access management (PAM) and password management solutions. Its KeeperPAM platform, secrets manager, endpoint privilege manager, and related products secure credentials, sessions, and remote access for enterprises, MSPs, and public-sector organizations using end-to-end encryption and a zero-knowledge architecture. Keeper operates primarily as a SaaS provider, emphasizes stringent compliance (FedRAMP, ISO, SOC 2, FIPS, PCI DSS, HIPAA), and is focused on preventing data breaches and managing privileged access across large-scale environments.
🕒 October 8
🇺🇸 United States – Remote
💵 Estimated: $100k - $123k / year
⏰ Full Time
🟡 Mid-level
🟠 Senior
⚙️ Software Development Engineer in Test (SDET)
👻 Ghost score 11%
Where this job comes from
Posted on Keeper Security, Inc.'s careers page ↗, not through a job board
First seen by Remote Rocketship October 8
Still open on Keeper Security, Inc.'s site. Checked 10 hours ago.

501 - 1000 employees
Founded 2011
🔒 Cybersecurity
☁️ SaaS
🏢 Enterprise
💰 Private Equity Round - Keeper Security on 2023-05
Cybersecurity • SaaS • Enterprise
Keeper Security, Inc. is a cybersecurity company that delivers cloud-first, zero-trust privileged access management (PAM) and password management solutions. Its KeeperPAM platform, secrets manager, endpoint privilege manager, and related products secure credentials, sessions, and remote access for enterprises, MSPs, and public-sector organizations using end-to-end encryption and a zero-knowledge architecture. Keeper operates primarily as a SaaS provider, emphasizes stringent compliance (FedRAMP, ISO, SOC 2, FIPS, PCI DSS, HIPAA), and is focused on preventing data breaches and managing privileged access across large-scale environments.
• Serve as an embedded quality engineering partner within Keeper’s AI team • Work alongside engineers and Product throughout design and development • Define test strategy, acceptance criteria and automation requirements • Design and maintain automated testing frameworks for AI-powered applications, backend services, APIs and supporting software systems • Develop deterministic and probabilistic validation strategies for AI/ML outputs • Define evaluation criteria, tolerances and quality thresholds for AI model and LLM-driven functionality • Build automated regression, integration, API and end-to-end coverage alongside feature development • Develop test harnesses and evaluation workflows for prompts, models, agents, tool-calling workflows and AI-integrated applications • Validate AI behavior across models, prompts, inputs and system configurations • Integrate automated validation and quality gates into CI/CD pipelines • Build and maintain test datasets, mocks, fixtures and synthetic data • Analyze model and application failures and produce clear, reproducible defect reports • Evaluate AI outputs for reliability, consistency, safety and alignment with expected product behavior • Improve application testability, observability and diagnostic capabilities • Track test cases, execution results and coverage using TestRail or similar platforms • Reduce flaky tests and improve speed, stability and maintainability of automated test suites • Contribute to AI testing methodologies and automation best practices • Use AI-assisted tools to improve automation development, test generation, debugging, analysis and documentation
• 5+ years of experience in SDET, software development, test automation or another code-intensive quality engineering role • Hands-on experience testing AI/ML, LLM-powered or model-integrated software systems • Strong understanding of deterministic software testing and non-deterministic AI/ML validation • Experience defining evaluation criteria, expected behaviors, tolerances or scoring approaches for AI-driven functionality • Strong programming skills in Python, Java, JavaScript/TypeScript, Rust or another general-purpose programming language • Significant experience designing, developing and maintaining automated test frameworks • Experience building automated functional, integration, API and end-to-end test coverage • Experience testing REST APIs and distributed application workflows using Postman, REST Assured or similar platforms • Experience integrating automated tests into CI/CD pipelines using GitHub Actions, Jenkins, GitLab CI or similar technologies • Experience working within an Agile software development team with close collaboration between QA, Engineering and Product • Strong understanding of shift-left testing, continuous quality and testability principles • Experience with TestRail or similar test management platforms • Strong debugging and troubleshooting skills using logs, APIs, application telemetry and development tools • Experience with Git-based development workflows, code review and modern software engineering practices • Familiarity with AI-assisted development and testing tools such as Claude, ChatGPT, GitHub Copilot or similar technologies • Strong analytical and problem-solving skills with the ability to evaluate variable AI behavior without relying solely on exact-match outcomes • Strong written and verbal communication skills and ability to collaborate closely with AI engineers, Software Engineers, Product Managers and QA professionals • Bachelor’s degree in Computer Science, Engineering or a related technical field, or equivalent practical experience • Qualified candidates must be a U.S. Person, defined as a U.S. citizen or lawful permanent resident • Preferred: experience testing LLMs, agentic systems, retrieval-augmented generation, tool calling or prompt-driven workflows • Preferred: experience building automated model evaluation, benchmarking or regression frameworks • Preferred: familiarity with AI evaluation metrics and techniques for measuring quality across non-deterministic outputs • Preferred: experience with Rust in production or test automation environments • Preferred: experience with performance, reliability, security or adversarial testing of AI-enabled systems • Preferred: experience with AI-assisted generation of automated tests or synthetic test data • Preferred: familiarity with Docker, Kubernetes or cloud-based testing environments • Preferred: experience testing cybersecurity, identity, PAM or other security-sensitive software • Preferred: experience building shared automation frameworks or internal testing tools used across engineering teams
• Medical, Dental & Vision (inclusive of domestic partnerships) • Employer Paid Life Insurance & Employee/Spouse/Child Supplemental life • Voluntary Short/Long Term Disability Insurance • 401K (Roth/Traditional) • A generous PTO plan that celebrates your commitment and seniority (including paid Bereavement/Jury Duty, etc)
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🕒 October 7
Senior Test Software Engineer architecting automated testing for Focus, a civic technology firm modernizing state and federal agency systems. Building Playwright and TypeScript test suites for critical infrastructure.
🇺🇸 United States – Remote
💵 $135k - $170k / year
⏰ Full Time
🟡 Mid-level
🟠 Senior
⚙️ Software Development Engineer in Test (SDET)
🦅 H1B Visa Sponsor
🕒 October 7
Lead Playwright test engineer developing automation for Cars Commerce’s Dealer Inspire automotive dealership platform. Establishing testing strategy, regression coverage, and quality practices.
🇺🇸 United States – Remote
💵 $135.3k - $169.2k / year
⏰ Full Time
🟠 Senior
⚙️ Software Development Engineer in Test (SDET)
🕒 October 6
Software Engineer in Test building Playwright, API, CI, and performance automation for Stord’s commerce and fulfillment platform. Developing AI-assisted testing workflows and release-quality infrastructure.
🕒 October 6
Staff SDET building scalable, AI-safe test platforms for Workiva’s financial reporting software. Leading distributed-systems quality engineering, CI/CD reliability, and performance validation.
🇺🇸 United States – Remote
💵 $129k - $210k / year
💰 $689.3k Venture Round on 2014-10
⏰ Full Time
🟡 Mid-level
🟠 Senior
🔴 Lead
⚙️ Software Development Engineer in Test (SDET)
🦅 H1B Visa Sponsor
🕒 September 29
Test Engineer validating networking products and AI infrastructure solutions at Nexthop AI. Building automation, maintaining testbeds, and troubleshooting complex hardware and software issues.