Senior AI Product Analyst – Voice AI Agents

🔥 30 minutes ago

🇬🇪 Georgia – Remote

⏰ Full Time

🟠 Senior

🔍 Product Analyst

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

MEDvidi

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2019

🏥 Healthcare

⚕️ Healthcare Insurance

💰 $2.8M Seed Round on 2022-09

Healthcare • Healthcare Insurance • Mental Health

MEDvidi is an online mental health treatment center aiming to make professional care accessible and affordable for everyone. The healthcare experts at MEDvidi provide personalized treatment plans for a variety of mental health conditions, including ADHD, anxiety, depression, insomnia, and OCD. With services that include initial assessments, ongoing support, and medication management through virtual consultations, MEDvidi seeks to enhance mental wellness with compassionate care tailored to individual needs.

📋 Description

• Analyze production behavior of Voice AI Agents and conversational AI workflows • Investigate hallucinations, inconsistencies, silent failures, and quality degradation in AI-driven conversations • Analyze call transcripts, logs, generated outputs, and operational datasets to uncover patterns and actionable insights • Design evaluation frameworks for measuring AI quality, reliability, and business impact • Build monitoring systems and dashboards for AI performance visibility • Measure the impact of AI systems on operational efficiency, business outcomes, and patient experience • Detect quality shifts, anomalies, and emerging failure modes in production environments • Partner with Product, Engineering, QA, and Operations teams on AI initiatives • Support rapid decision-making in fast-changing and ambiguous environments

🎯 Requirements

• 5+ years of experience in Product Analytics, Data Analytics, Operational Analytics, or analytics roles within complex production systems • Strong SQL skills • Python for analytical investigations and working with large-scale text datasets • Experience working with ML pipelines or AI-powered products • Understanding of LLM limitations, hallucinations, evaluation challenges, prompt sensitivity, and AI failure modes • Experience building monitoring systems, analytical frameworks, or operational dashboards • Strong communication skills and ability to translate analysis into product decisions • Ability to work effectively in ambiguous and fast-changing environments • Fluent Russian • English level B2 or higher • Ability to work CET-overlapping hours • Experience with conversational AI or AI agents is a plus • Experience evaluating LLM outputs is a plus • Experience with AI quality metrics and evaluation methodologies is a plus • Experience with prompt iteration and AI evaluation frameworks is a plus

🏖️ Benefits

• Competitive compensation and clear growth opportunities • Health insurance after the probation period • Sports & wellness compensation • Fully remote, long-term B2B collaboration • Career growth • Personalized English lessons via Preply • 19 working days of vacation per year • 4 additional wellness days • Paid sick leave for the first 5 working days • Thoughtful gifts for important life events