AI Conversation Research, Evaluation Specialist

🔥 17 minutes ago

🌐 Netherlands, Germany, +4 more countries – Remote

🇳🇱 Netherlands – Remote 🇩🇪 Germany – Remote 🇸🇪 Sweden – Remote 🇨🇭 Switzerland – Remote 🇳🇿 New Zealand – Remote 🇪🇸 Spain – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Gramian Consulting

WebsiteLinkedInAll Job Openings

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Review AI conversations involving real-world interpersonal situations and everyday decision-making • Identify missing context and recommend relevant follow-up questions to improve AI responses • Evaluate whether additional information would materially change an AI-generated recommendation • Distinguish decision-relevant information from non-essential or descriptive details • Conduct qualitative reviews and document findings using structured evaluation guidelines • Assess personal, psychological, social, financial, practical, and organizational factors in conversations • Identify missed opportunities for clarification, deeper understanding, and information gathering • Review conversations involving relationships, work, education, family, wellbeing, planning, and resource constraints • Collaborate with research teams on consistent, evidence-based assessments • Maintain accuracy, clarity, and consistency while meeting project deadlines

🎯 Requirements

• At least 3–5 years of relevant direct professional experience in one or more listed domains • Licensed Social Work pathway: Master's degree in Social Work (MSW) or equivalent graduate-level qualification • Licensed Social Work pathway: LCSW, LICSW, LMSW, or equivalent applicable social work license or credential • Licensed Social Work pathway: Experience in client assessment, case review, interviewing, counseling, or related social-work practice • Counseling, Therapy, or Psychology pathway: Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy license or credential; or PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology • Counseling, Therapy, or Psychology pathway: Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work • Qualitative Research, HCI, or Communication pathway: MA, PhD, or equivalent advanced expertise in a related discipline • Qualitative Research, HCI, or Communication pathway: Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, or qualitative coding • Ability to analyze conversations systematically and identify missing context, communication patterns, and opportunities for clarification • Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields pathway: Relevant professional qualification, credential, or demonstrated subject-matter expertise • At least 5 years of direct advisory or client-facing experience for candidates qualifying through the advisory pathway • Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work • Demonstrated ability to gather context, understand individual or organizational needs, and provide informed recommendations