Test & Evaluation Lead

🔥 12 hours ago

🇺🇸 United States – Remote

💵 $170k - $210k / year

⏰ Full Time

🟠 Senior

Where this job comes from

Posted on Primordial Labs's careers page ↗Primordial Labs's careers page, not through a job board

First seen by Remote Rocketship 12 hours ago

Still open on Primordial Labs's site. Checked 16 minutes ago.

Apply Now
Logo of Primordial Labs

Primordial Labs

11 - 50 employees

Founded 2021

🎖️ Defense

📦 Logistics

💼 Consulting

💰 $4M Seed Round - Primordial Labs on 2022-10

Defense • Logistics • Consulting

Primordial Labs is an autonomy company that builds natural-language human-machine interfaces and edge-deployable autonomy software (branded Anura) for defense and national security customers. The team combines engineers and former special operators to rapidly prototype and deploy AI-driven, NLP-enabled systems that can run on constrained edge hardware — including drones and other fielded platforms. Primordial Labs operates as a distributed, fully remote company focused on delivering practical autonomy and mission-focused solutions for warfighters.

📋 Description

• Define the testing strategy from automated suites on every build through simulation and system-level tests on real platforms • Design and build automated test and evaluation capabilities running on simulation and hardware-in-the-loop environments • Build and maintain end-to-end performance scenarios, including failure cases such as ambiguous commands, lost links, and unexpected mission changes • Develop and own test KPIs based on acceptance criteria and mission-level performance measures • Track KPIs across builds, identify defects that pass test gates, and report results to leadership and customers • Set build-entry criteria for physical testing and provide final readiness sign-off for customer releases • Convert physical-test field data into replayable regression cases and evaluation additions • Lead physical test engineers, oversee test planning and field events, and grow the team • Travel occasionally to test ranges and field events • Produce test reports and readiness evidence for leadership, customers, and program offices • Partner with systems engineering, mission engineering, simulation, and DevOps teams • Keep test independent from the engineering teams it evaluates

🎯 Requirements

• 6+ years in QA, test engineering, test automation, or systems test, including experience leading engineers or test efforts • Deep, hands-on experience building automated test suites and frameworks for complex software, and keeping them fast and trustworthy • Strong proficiency in Python • Comfort in Linux • Hands-on experience with CI • Demonstrated experience defining test strategy, standards, KPIs, and readiness criteria for complex systems • Working knowledge of testing on real hardware or platforms, and how field testing fits into a broader test strategy • Familiarity with simulation and hardware-in-the-loop testing • BS in Computer Science, Engineering, or a related technical field, or equivalent hands-on experience • U.S. Citizenship required • Current residency within the United States required • Permanent Residency or visa sponsorship cannot satisfy the regulatory requirements • Experience building evaluation for ML models in production, including test set design, metric selection, and catching regressions that standard accuracy numbers hide (nice to have) • Experience testing systems with ML components (nice to have) • Robotics, unmanned systems, or autonomy test experience (nice to have) • Defense test and evaluation experience, including test plans, TEMPs, and government deliverable reporting (nice to have) • Experience building a test function at a startup or small company (nice to have)

🏖️ Benefits

• Significant equity stake • 100% remote for residents across the US • Comprehensive medical, dental, and vision plans • 401(k) package with a 6% company match • Generous Discretionary Time Off (DTO) policy • Elite technology package • Low-stress interview experience with no trick questions or brain teasers

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 12 hours ago

Sunrise

51 - 200

🏥 Healthcare

🤖 Artificial Intelligence

🔧 Hardware

Sleep Technologist supporting PAP therapy initiation, troubleshooting, and adherence for Dreem Health’s digital sleep clinic. Improving patient outcomes through remote sleep-care support.

🇺🇸 United States – Remote

💵 $65k - $73k / year

💰 $29.4M Venture Round - Sunrise on 2025-09

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔥 12 hours ago

Dreem Health | Sunrise

11 - 50

💼 Consulting

📦 Logistics

🏥 Healthcare

Sleep Technologist supporting PAP initiation, troubleshooting, and adherence for Dreem Health’s digital sleep clinic. Providing remote, patient-centered sleep apnea care and follow-up.

🔥 13 hours ago

GitLab

1001 - 5000

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Senior candidate experience lead coordinating interviews, offers, and recruiting operations for GitLab’s DevSecOps platform. Developing regional specialists and improving global candidate-experience processes.

🇺🇸 United States – Remote

💵 $53.6k - $91.2k / year

💰 Secondary Market on 2020-11

⏰ Full Time

🟠 Senior

🔥 13 hours ago

Pinnaql

201 - 500

💊 Pharmaceuticals

🧬 Biotechnology

Senior CSV Specialist validating computerized systems and data integrity for regulated pharmaceutical manufacturing. Supporting laboratory, sterile, and non-sterile operations for life sciences clients.

🗣️🇪🇸 Spanish Required

🔥 14 hours ago

American Military University

1001 - 5000

💼 Consulting

🎖️ Defense

🏥 Healthcare

Department Chair leading Biology programs and faculty for American Public University System, an online university serving military and public-service communities. Driving academic quality, retention, and curriculum innovation.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok