Senior QA Automation Engineer – AI Products, Customer Implementations

Job not on LinkedIn

🔥 18 hours ago

🌐 Ukraine, Mexico – Remote

🇺🇦 Ukraine – Remote 🇲🇽 Mexico – Remote

⏰ Full Time

🟠 Senior

⚙️ Software Development Engineer in Test (SDET)

👻 Ghost score 10%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Helpware

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2015

📦 Logistics

📣 Marketing

💼 Consulting

💰 Seed Round on 2016-01

Logistics • Marketing • Consulting

Helpware is a digitally enabled People as a Services Outsourcer dedicated to enhancing customer experiences for high-growth, market-disrupting, and technology companies. They specialize in providing a wide array of services such as digital customer experience, content control and verification, AI-driven customer service, back-office support, and data labeling. Helpware also assists in areas like digital marketing support, cybersecurity, and software development. Operating globally, they offer culturally aligned and scalable team solutions across multiple countries. Helpware aims to drive brand loyalty and efficiency for its clients by providing human task services integrated with technology solutions.

📋 Description

• Own test strategy for one or more AI portfolio products from requirements review through release sign-off • Design, build, and maintain automated API, UI, integration, and regression test suites integrated into CI/CD pipelines • Test multi-tenant platform behavior, including RBAC, tenant isolation, data access, and third-party integrations • Validate AI-agent behavior against functional requirements, including conversation flows, workflow automation, scoring and coaching logic, and structured-data extraction • Lead QA for customer implementations by validating configurations, connectors, knowledge bases, scoring rubrics, and workflow rules before go-live • Design and execute UAT plans with client stakeholders and internal delivery and Customer Success teams • Perform exploratory and scenario-based testing against real customer workflows • Monitor early-production behavior after launch • Distinguish configuration issues, implementation defects, and product-level bugs, ensuring appropriate teams address them • Triage, document, and track defects; collaborate with engineers on root-cause analysis and fix verification • Maintain scalable test plans, implementation checklists, and QA playbooks • Convert recurring implementation issues into automated regression coverage and improve QA processes • Report release readiness, product quality, and implementation risks to Product, Engineering, Delivery, and client-facing teams

🎯 Requirements

• 5+ years of experience in software QA, including both product-level testing and customer-facing implementation or UAT activities • Strong hands-on experience with test automation using Playwright, Cypress, Selenium, or similar • Solid experience with API testing using Postman, REST-assured, or comparable tools • Strong manual and exploratory testing skills • Ability to create meaningful test scenarios from business and client requirements • Experience testing multi-tenant and role-based access systems, including data isolation and configuration-driven deployments • Ability to read and understand API and database schemas and work with engineers on root-cause analysis • Experience working with CI/CD pipelines and integrating automated tests into development and release processes • Comfortable working directly with external stakeholders during UAT and implementation validation • Strong understanding of software testing principles, defect lifecycle, regression strategy, and release readiness • Clear written and verbal communication skills, with the ability to adapt communication for technical and client-facing audiences • Nice to have: Experience testing AI/LLM-powered products, including accuracy evaluation, hallucination checks, prompt regression, RAG quality, or AI output validation • Nice to have: Experience in customer support, contact center, or BPO technology • Nice to have: Familiarity with AWS-based environments and cloud-based application testing • Nice to have: Experience with observability, logging, tracing, or monitoring tools • Nice to have: Exposure to SOC 2, HIPAA, or PCI-DSS environments • Nice to have: Experience testing integrations with Zendesk, Freshdesk, Intercom, telephony systems, or other customer-support technologies