AI Conversation Evaluation, Context Research Specialist

🔥 0 minutes ago

🌐 Brazil, Mexico, +4 more countries – Remote

🇧🇷 Brazil – Remote 🇲🇽 Mexico – Remote 🇦🇷 Argentina – Remote 🇨🇴 Colombia – Remote 🇵🇱 Poland – Remote 🇷🇴 Romania – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔬 Research Analyst

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Gramian Consulting

WebsiteLinkedInAll Job Openings

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Review AI conversations involving interpersonal relationships, workplace situations, education, family matters, everyday planning, wellbeing, and other real-world decisions • Evaluate whether the AI gathered sufficient context before providing advice, recommendations, or proposed solutions • Identify missing information and suggest relevant follow-up questions that could improve the quality of the AI's response • Assess whether additional context would materially change the recommendation or decision • Distinguish between load-bearing information that could change the outcome and non-essential or merely descriptive details • Conduct qualitative reviews using structured evaluation guidelines and document findings consistently • Identify missed opportunities for clarification, contextual understanding, and information gathering • Consider relevant personal, psychological, social, financial, practical, and organizational factors when evaluating conversations • Collaborate with research teams to maintain consistent evaluation standards and high-quality assessments • Complete assigned tasks accurately within the required project timelines

🎯 Requirements

• At least 3–5 years of direct professional experience in one or more listed domains • Licensed Social Work pathway: Master's degree in Social Work (MSW) or an equivalent graduate-level qualification • LCSW, LICSW, LMSW, or an equivalent applicable social work credential or license • Experience in client assessment, case review, interviewing, counseling, or related social-work practice • Counseling, Therapy, or Psychology pathway: Master's degree in a relevant discipline with an LMFT, LPC, LCPC, or equivalent counseling or therapy credential; or PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology • Relevant experience in counseling, therapy, psychological assessment, interviewing, case review, or other client-facing professional work • Qualitative Research, HCI, or Communication pathway: MA, PhD, or equivalent advanced expertise in Human-Computer Interaction, Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline • Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities • Ability to analyze conversations systematically and identify missing context or patterns in human communication • Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields pathway: relevant professional qualification, credential, or demonstrated subject-matter expertise • At least 5 years of direct advisory or client-facing experience for candidates qualifying through this pathway • Experience in coaching, mediation, student advising, organizational consulting, or comparable professional work • Demonstrated ability to gather context, understand individual or organizational needs, and provide informed recommendations