Senior AI Product Analyst – Automation Team

🔥 1 minute ago

🇷🇸 Serbia – Remote

⏰ Full Time

🟠 Senior

🔍 Product Analyst

🗣️🇷🇺 Russian Required

Where this job comes from

Posted on MEDvidi's careers page, not through a job board

First seen by Remote Rocketship 1 minute ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of MEDvidi

MEDvidi

201 - 500 employees

Founded 2019

🏥 Healthcare

⚕️ Healthcare Insurance

💰 $2.8M Seed Round on 2022-09

Healthcare • Healthcare Insurance • Mental Health

MEDvidi is an online mental health treatment center aiming to make professional care accessible and affordable for everyone. The healthcare experts at MEDvidi provide personalized treatment plans for a variety of mental health conditions, including ADHD, anxiety, depression, insomnia, and OCD. With services that include initial assessments, ongoing support, and medication management through virtual consultations, MEDvidi seeks to enhance mental wellness with compassionate care tailored to individual needs.

📋 Description

• Own the full product analytics stack for shipped AI-powered and conventional product features • Conduct discovery and sizing, experiment design and analysis, funnel and adoption analysis, and post-release impact assessment • Analyze production behavior of AI and automation workflows across clinical and operational journeys • Investigate hallucinations, silent failures, and quality degradation in AI-generated output • Analyze logs, transcripts, generated artifacts, and operational data to identify patterns dashboards miss • Design automated and human-review evaluations for AI quality • Feed evaluation results into prompt and product changes • Build monitoring and dashboards for AI and automation health and related operational metrics • Measure business and operational impact of automation initiatives and surface associated risks • Partner with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity

🎯 Requirements

• 5+ years of experience in Product Analytics, Operational Analytics, Data Analytics, or analytics roles within complex production systems • Understanding of AI, ML, and LLM systems • Hands-on experience evaluating LLM or AI output is a strong plus, including prompt iteration, evaluation frameworks, and human review pipelines • Effective, structured written and verbal communication • Ability to turn analysis into crisp, decision-ready writeups for non-analysts • Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed • Strong product / operational analytics background • Experience owning metrics end-to-end • Ability to write SQL and Python code against messy production data • Fluent Russian • English level B2 or higher • Ability to work CET-overlapping hours in a B2B format • Experience evaluating LLM outputs or AI systems is nice to have • Previous experience in Data Science or Machine Learning is nice to have

🏖️ Benefits

• Competitive compensation and clear growth opportunities • Fully remote, long-term B2B collaboration • Health insurance after the probation period • Sports & wellness compensation • Career growth opportunities • Personalized English lessons via Preply • 19 working days of vacation per year • 4 additional wellness days • Paid sick leave for the first 5 working days • Thoughtful gifts for important life events

Apply Now

Similar Jobs

🕒 September 28

Social Discovery Group

1001 - 5000

🌍 Social Impact

📱 Media

Senior Product Analyst guiding experiments, metrics and growth for Social Discovery Group’s matchmaking, messaging and AI-assisted products. Remote role across five eligible countries.

🕒 September 22

Social Discovery Group

1001 - 5000

🌍 Social Impact

📱 Media

Senior Product Analyst driving experiments, metrics, and growth across Social Discovery Group’s social connection products. Remote role supporting Matching & Relationships product directions.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok