Lead QA Engineer – AI Voice

Job not on LinkedIn

🔥 0 minutes ago

🇵🇱 Poland – Remote

⏰ Full Time

🟠 Senior

🔧 QA Engineer (Quality Assurance)

👻 Ghost score 11%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Lingaro

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2008

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Lingaro is an end-to-end data services and analytics partner for global brands and enterprises, delivering data strategy, platform engineering, AI/ML (including generative AI), and data governance to unlock business value. It combines domain-focused analytics (supply chain, commercial/RGM, digital commerce, sustainability) with data platforms, visualization, MLOps, and secure cloud (Google Cloud) integrations, plus a creative arm (ALCHEMY) for data-driven brand and commerce experience design.

📋 Description

• Design the voice AI test strategy and process from speech input through speech recognition (ASR), the LLM, tools and integrations, to speech output • Define the automation approach and how it scales, including multilingual coverage of around 100 languages • Test predictable behaviour such as intents, routing, and integrations, as well as non-deterministic AI behaviour • Evaluate prompts and LLM responses using test datasets and scoring criteria • Lead UAT planning, scenarios, test data, business tester coordination, and sign-off recommendation • Gather business acceptance criteria and turn them into measurable targets • Own defect and risk management and provide release go/no-go recommendations • Replan and communicate options when development is delayed • Challenge stakeholders on readiness and quality • Mentor the Regular engineer

🎯 Requirements

• At least 6 years of experience in software QA • At least 2 years of experience testing voice agents or conversational AI in live delivery • Experience leading E2E and UAT, and working as the lone or lead QA with limited guidance • Experience in international or distributed teams • Voice AI testing, including speech recognition, speech output, latency, interruptions, accents, and noise • Knowledge of voice quality metrics such as word error rate, intent accuracy, and task completion • Practical understanding of how LLMs work and fail • Test automation in Python or JavaScript/TypeScript, with CI/CD and API testing such as Postman • Experience using cloud speech services such as Azure, Google, AWS, or similar to generate test calls • Practical experience with Jira or Azure DevOps and a test management tool • Practical experience troubleshooting from logs, transcripts, and call recordings • Structured, recommendation-first communication with technical and business stakeholders • English at least B2 • Voice testing platforms such as Hamming, Cekura, Coval, or Botium are a plus • Experience with LLM evaluation tools such as Promptfoo, DeepEval, or LangSmith is a plus • Experience with telephony basics such as SIP, Twilio, or Azure Communication Services is a plus • ISTQB certification is a plus • Experience in Responsible-AI testing, including PII, bias, and safety, is a plus • Experience validating customer journeys across multiple markets is a plus

🏖️ Benefits

• Stable employment • “Office as an option” model: choose to work remotely or in the office • Workation in line with the workation policy • Great Place to Work® certified employer • Flexibility regarding working hours and preferred form of contract • Comprehensive online onboarding program with a “Buddy” from day 1 • Cooperation with top-tier engineers and experts • Unlimited access to the Udemy learning platform from day 1 • Certificate training programs • Upskilling support, capability development programs, Competency Centers, knowledge sharing sessions, community webinars, and 110+ training opportunities yearly • Internal promotion and career growth opportunities • Diverse, inclusive, and values-driven community • Autonomy to choose the way you work • Referral bonuses • Activities supporting well-being and health • Opportunities to donate to charities and support the environment • Modern office equipment purchased for you or available to borrow, depending on location

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume