QA Engineer – AI-Assisted Testing

🔥 0 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

ECFX

WebsiteLinkedInAll Job Openings

11 - 50 employees

⚖️ Legal

💰 $1.3M Seed Round on 2021-02

Legal • Software • Legal Tech

ECFX is a company that specializes in automating the processing of electronic court filing (ECF) notices for law firms. Their product, ECFX Notice, is an enterprise notice management system that helps law firms save time by automatically handling all Federal and State notices. By automating the complex and manual processes involved in ECF notice management, ECFX enables law firms to focus more on client work rather than administrative tasks. Founded by Dan O’Day, a lawyer and programmer with extensive experience in legal technology, ECFX integrates seamlessly with existing case management, document management, and time and billing software, offering customizable templates and dashboards for improved visibility and control. The company targets various firm sizes, including single office firms, multi-office firms, national firms, and insurance companies, aiming to mitigate risks, gain control, improve visibility, and enhance operational efficiency.

📋 Description

• Use AI tools such as Claude, Claude Code, Cursor, or ChatGPT to analyze tickets, merge requests, and code diffs; identify risks and edge cases; draft test charters and checklists; and prioritize testing • Perform risk-based exploratory, functional, and regression testing across the Vue dashboard, admin tools, email notifications, and integrations • Verify document retrieval, parsing, categorization, storage, and delivery across court portals, 2FA/OTP logins, and integrations including Clio, Filevine, iManage, and NetDocuments • Test backend and platform changes using API calls, SQL queries, logs, and Grafana/Loki and Sentry dashboards • Generate realistic test data, court notice emails, and edge-case documents using AI; operate simulators and test environments • Evaluate AI document categorization and an MCP server used by AI assistants; assess accuracy and consistency, test unusual or hostile inputs, and identify regressions • Test password, SAML SSO, and OAuth logins, user roles and permissions, and tenant data isolation • Investigate and reproduce customer-reported and production issues; write actionable bug reports • Optionally create focused automated checks, including Playwright scripts or API checks, for high-risk flows • Collaborate with engineers and product managers in sprint planning, backlog refinement, and retrospectives • Help write testable acceptance criteria and raise quality risks early

🎯 Requirements

• 3 to 7 years in software quality assurance for web or SaaS applications • Deep experience in exploratory and manual testing of complex, data-heavy systems • Daily use of AI assistants in testing, including generating test ideas, edge cases, test data, SQL/log queries, log or diff summaries, bug reproduction, and reports • Skill at prompting AI assistants with relevant context • Ability to verify AI output and identify confidently incorrect results • Understanding of testing nondeterministic AI features using repeated trials, sample sets, and correctness checks • Safe handling of data using synthetic or masked data with AI tools • Comfort with command line, Git, and reading logs • Some experience with Docker or Kubernetes is a plus • Experience with defect tracking and test management in Jira • Experience writing or maintaining automated tests, such as Playwright, Selenium, or API test scripts • Experience testing AI or LLM features, including classification accuracy, hallucinations, and prompt injection • SQL skills for PostgreSQL • Experience testing APIs with Postman, curl, or Bruno; understanding of HTTP, REST, and JSON • Experience with web security testing, including authentication, sessions, roles and permissions, OAuth2/SAML, CSRF, and XSS • Experience using AI browser tools, such as Playwright MCP or browser agents • Experience testing third-party integrations, email-driven workflows, or browser automation against external sites • Experience with accessibility testing (WCAG 2.2 AA) • Knowledge of the legal domain, especially court e-filing, docketing, or legal document management • ISTQB or similar QA certification • Understanding of or experience with the Lean Startup approach • Sharp attention to detail, curiosity, and a methodical approach • Strong written and verbal communication • Ability to take ownership and find ways to test apparently untestable functionality

🏖️ Benefits

• Fully remote role open to every US time zone, Hawaii included • Flexible working hours • Health, dental, vision, and life insurance options • Discretionary time off (DTO), in addition to scheduled vacations and holidays, with supervisor approval • Employee stock option plan • Company-provided AI tools • Supportive approach to getting work done