Senior Software Development Engineer in Test

Job not on LinkedIn

🔥 7 minutes ago

🤠 Texas – Remote

infoinfo

⏰ Full Time

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

Where this job comes from

Posted on Qualia's careers page, not through a job board

First seen by Remote Rocketship 7 minutes ago

Logo of Qualia

Qualia

201 - 500 employees

Founded 2015

🏠 Real Estate

☁️ SaaS

💳 Fintech

Real Estate • SaaS • Fintech

Qualia is a company that provides cloud-based software solutions for the real estate and mortgage industries, focusing on streamlining and enhancing the closing process. Its comprehensive suite of digital closing products includes solutions for title and escrow production, wire fraud detection, remote online notarization, and more. Qualia's platform enables real estate agents, title insurers, and closing service providers to deliver efficient, error-free, and transparent buying, selling, and refinancing experiences. The platform also offers robust integration options, modern infrastructure, and robust security standards, including SOC 2 certification. With a focus on real estate digital transformation, Qualia supports thousands of real estate and mortgage professionals nationwide.

📋 Description

• Build and maintain production-grade test infrastructure, AI/ML evaluation systems, agentic validation harnesses, release orchestration tooling, observability, and performance-testing platforms • Design agentic test harnesses enabling AI agents to interact with applications, browsers, APIs, databases, logs, telemetry, and CI/CD systems • Build AI/ML evaluation frameworks for non-deterministic systems using assertions, semantic/model-based evaluation, regression datasets, and human-in-the-loop review • Define quality signals including correctness, reliability, latency, cost, and hallucination/error rates • Build observability and telemetry with structured logs, metrics, distributed tracing, and execution timelines • Distinguish product, test, infrastructure, and AI/model reasoning failures and accelerate root-cause analysis • Design and build test automation frameworks, including migration from Cypress to Playwright • Own test environment provisioning, parallelization, and CI/CD integration at scale • Apply AI to test generation, flaky-test triage, failure clustering, and release-risk analysis with evidence-based guardrails • Partner with Software Engineering, Quality Engineering, SRE, and Platform teams; mentor engineers on test architecture, observability, and AI-assisted engineering

🎯 Requirements

• 5+ years of experience as an SDET or software engineer building test infrastructure, developer tooling, platform engineering, observability, or release engineering systems • Strong programming ability in JavaScript/TypeScript, including designing backend services, libraries, frameworks, and production-quality infrastructure from scratch • Strong software engineering fundamentals including system design, distributed systems, APIs, asynchronous systems, and production operations • Experience building or scaling CI/CD systems, release orchestration, test infrastructure, or developer platforms • Experience designing observability/telemetry systems using structured logging, metrics, and distributed tracing • Hands-on experience with LLMs, AI-assisted engineering, or agentic systems beyond simply using an AI coding assistant, including tool/function calling, agent workflows, and multi-step AI workflows • Experience or familiarity with LLM and agent evaluation, including evaluation datasets, deterministic and model-based evaluators, and testing probabilistic/non-deterministic systems • Strong understanding of the testing pyramid and experience determining validation layers • Comfortable mentoring engineers and raising technical quality across teams • Familiarity with JavaScript / Node.js / TypeScript, Playwright, LLM APIs, tool/function calling, agent frameworks, structured outputs, RAG/context retrieval, Jest, Postman / REST Assured, performance-testing tools, CI/CD and release-orchestration tools, Datadog, OpenTelemetry, MongoDB, microservice architecture, Kubernetes, AWS, and Google Cloud

🏖️ Benefits

• Comprehensive health plans • 401k program • Commuter benefits • Professional development • Parental leave • Flexible time off policy • Robust online onboarding program • Biweekly all hands meetings • Internal virtual events

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 8 minutes ago

Dark Wolf Solutions

51 - 200

💼 Consulting

📦 Logistics

🏥 Healthcare

Senior Test Engineer architecting automated testing for Dark Wolf Solutions’ embedded, edge, and network products. Validating performance, reliability, security, and compliance through lab and field testing.

🔥 2 hours ago

AIS (Applied Information Sciences)

501 - 1000

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Technical QA and Automation Lead establishing test strategy and automation for AIS’s enterprise migrations from on-premises systems to Azure and AWS. Guiding QA engineers and technical acceptance.

🔥 8 hours ago

Crown Consulting, Inc.

51 - 200

🚀 Aerospace

🏛️ Government

💼 Consulting

Remote aviation software verification engineer testing DO-178C navigation systems at Crown Innovations. Developing certification-ready test evidence for safety-critical avionics.

🔥 8 hours ago

Ease Health

51 - 200

🏥 Healthcare

☁️ SaaS

🤝 B2B

Software Development Engineer in Test building automated CI/CD testing for Ease’s AI-native behavioral health platform. Evaluating LLM features and preventing clinical billing and scheduling defects.

🇺🇸 United States – Remote

🔥 Funding within the last year

💰 $41M Series A on 2026-03

⏰ Full Time

🟡 Mid-level

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

🔥 8 hours ago

AIS (Applied Information Sciences)

501 - 1000

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Cloud migration test automation engineer validating applications moved to Azure and AWS for AIS. Building automated tests, validating integrations, and preparing migration acceptance evidence.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok