QA Lead, AI Agents

Job not on LinkedIn

🔥 2 minutes ago

🇮🇳 India – Remote

💵 ₹1.2M - ₹2M / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Rifa AI

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2023

🤖 Artificial Intelligence

🏥 Healthcare

🤝 B2B

💰 $1.1M Seed Round on 2025-08

Artificial Intelligence • Healthcare • B2B

Rifa AI is a platform for building and deploying voice and chat AI agents purpose-built for regulated industries like debt collection, healthcare, and insurance. It provides compliant, scalable AI agents that deliver required disclosures, maintain full audit trails, and offer unified observability across AI, human, and hybrid interactions through its Reflect product. Rifa AI emphasizes rapid deployment (days to weeks), built-in compliance controls (FDCPA, HIPAA, TCPA), smart handoff routing to human agents for exceptions, multilingual support (English, Hindi, Marathi), integrations with CRMs and payment systems, SOC 2 Type II certification, encryption, role-based access, and no-use of customer data for model training. The platform includes voice and chat agents for payments, account servicing, scheduling, claims status, patient intake, and observability features like searchable transcripts, verification, disposition codes, and compliance metrics.

📋 Description

• Lead the QA team by setting audit standards and scorecards, reviewing work, coaching analysts, and deciding escalations • Pair with Agent Engineers to provide transcript and audit evidence, verify fixes, and confirm they hold in production • Audit call and chat transcripts in Reflect and evaluate AI-agent performance against quality and compliance standards • Identify regressions, compliance gaps, mishandled flows, and edge cases, documenting issues with transcript or metric evidence • Translate findings into actionable Linear cards with reproduction steps, affected conversations, and client impact • Join client QA and audit calls, present findings, and answer questions about agent performance • Reconcile internal QA findings with client audit-team results and align on a defensible shared quality assessment • Feed insights, recurring issues, and trends to the Technical Program/Product Manager for release communications, weekly syncs, and monthly reviews

🎯 Requirements

• At least 2 years in QA, operations, quality analysis, delivery support, or a similar client-facing role, ideally at a B2B SaaS, financial-services or consulting company • Experience leading or mentoring a QA or operations team, including setting standards, building processes, reviewing work, and maintaining quality standards • Ability to use data and transcripts as evidence and independently evaluate and support findings • Clear written and spoken English • Reliable daily overlap with US business hours (ET/CT), involving a late-afternoon-into-evening IST schedule • Comfort participating in calls with client operations or compliance teams • Precision, organization, attention to detail, and follow-through • Experience in debt collections, lending, another regulated financial-services domain, or familiarity with FDCPA/compliance workflows is advantageous • Hands-on experience with QA tooling, call-quality scoring, or observability/audit dashboards is advantageous • Experience building or running testing and auditing frameworks, including test plans, regression suites, QA scorecards, or compliance audit programs is advantageous • Interest in AI/conversational systems and their production behavior is advantageous

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume