Quality Assurance Engineer

🕒 July 27

🇮🇳 India – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

Where this job comes from

Posted on Hupo's careers page ↗Hupo's careers page, not through a job board

First seen by Remote Rocketship July 27

Still open on Hupo's site. Checked 6 hours ago.

Apply Now
Logo of Hupo

Hupo

11 - 50 employees

Founded 2022

🤖 Artificial Intelligence

☁️ SaaS

🛡️ Insurance

Artificial Intelligence • SaaS • Insurance

Hupo is an AI-first company (founded in 2022) that builds a full-stack, software platform to coach and upskill frontline financial advisors and insurance distributors. Using AI to restore confidence, accelerate learning, and improve sales performance, Hupo targets Wealth & Insurance distribution and sells enterprise-grade coaching and productivity tools designed to reduce early rep churn and accelerate mastery. The company emphasizes remote, high-autonomy culture and positions its product as an AI-powered engine for enterprise clients in financial services and insurance distribution.

📋 Description

• Build and maintain automated testing for AI voice and chat agents, from single conversational turns to full roleplay flows. • Test LLM output quality - correctness, consistency, structured output, language fidelity, prompt regression - using evaluation harnesses (LLM-as-judge, golden datasets, tolerance-based assertions for non-determinism). • Validate RAG pipelines: retrieval relevance, grounding/faithfulness, and answer quality. • Test voice pipelines: STT/TTS accuracy and real-time, low-latency behavior across languages. • Automate across UI/E2E, API, and AI output layers, and build CI/CD from scratch - lint, type-check, tests, evals, coverage gates, deployment checks. • Own release quality: regression strategy, catching breakages early, and clear go/no-go calls. • Cover database and load/performance testing; extend automation to desktop and mobile clients. • Take over and extend existing QA automation, and strengthen shared frameworks, tooling, and QA processes/standards.

🎯 Requirements

• 5+ years as a QA Automation Engineer, with a proven track record testing AI systems - not just traditional software. • Builder mindset: established testing frameworks, standards, and CI/CD-integrated automation from scratch. • Hands-on experience testing conversational AI - voice and/or chat agents - on real, shipped projects. • Strong grasp of LLMs, prompt engineering, and RAG - designing tests for nondeterministic output and evaluating retrieval/generation quality. • Understanding of voice pipelines (speech-to-text, text-to-speech) and how to test them in automation. • Hands-on with LLM evaluation/observability tooling - e.g. Langfuse, LangSmith, DeepEval, RAGAS. • Proficient in UI/E2E (e.g. Playwright) and API test automation; experience building CI/CD pipelines from scratch. • Comfort with database testing, load/performance testing, and desktop/mobile test automation. • Solid Git discipline, basic cloud knowledge, and familiarity with the agile sprint lifecycle. • Track record in fast-paced, fast-shipping environments - ramps quickly on unfamiliar systems, pragmatic about process.

🏖️ Benefits

• Flexible work arrangements

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 July 27

QuantumLoopAi

51 - 200

🏥 Healthcare

🤖 Artificial Intelligence

☁️ SaaS

QA Automation Engineer at QuantumLoopAI, ensuring automated testing for a live voice AI platform. Collaborating remotely and enhancing conversation quality through robust testing.

🇮🇳 India – Remote

💰 $2M Convertible note on 2025-02

⏰ Full Time

🟡 Mid-level

🔧 QA Engineer (Quality Assurance)

🕒 July 16

ZEISS VisioGen

51 - 200

🏥 Healthcare

🤖 Artificial Intelligence

☁️ SaaS

Senior QA Engineer responsible for Manual and Automation Testing in the healthcare sector. Collaborating with teams to ensure high-quality software and guide junior engineers.

🕒 July 15

Jeeves

51 - 200

💼 Consulting

📦 Logistics

📣 Marketing

Senior QA Engineer driving industry best practices for product quality at Jeeves, a financial operating system for businesses. Collaborating with teams and improving testing processes in a remote setup.

🕒 July 13

Everest Technologies, Inc

51 - 200

💼 Consulting

📦 Logistics

📣 Marketing

QA Engineer in Supply Chain Practice performing tests on Manhattan Active WM systems. Collaborating with teams to ensure high-quality solutions.

🕒 June 24

Gururo

11 - 50

💼 Consulting

📣 Marketing

📚 Education

Software Tester responsible for executing diverse testing methodologies and enhancing the usability of applications. Collaborates with developers and contributes to quality processes throughout the software development life cycle.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok