Social Workers, AI Conversation Evaluation

Job not on LinkedIn

🔥 0 minutes ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Gramian Consulting

Gramian Consulting

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Review AI conversations involving interpersonal, advisory, and everyday decision-making scenarios • Assess whether the AI gathered sufficient context before making recommendations • Identify important missing information and suggest relevant follow-up questions • Determine whether additional context could materially change the recommendation • Distinguish between load-bearing information and non-essential details • Conduct structured qualitative reviews using defined evaluation guidelines • Document findings clearly in spreadsheets, annotation tools, or labeling platforms • Apply consistent judgment across cases and flag ambiguous examples • Collaborate with research and quality teams to improve evaluation standards • Participate in calibration and quality-review activities

🎯 Requirements

• Background in psychology, social work, counseling, communication, qualitative research, HCI, conflict resolution, or related advisory disciplines • MSW with LCSW or equivalent social-work license; or MA/MS with LMFT, LPC, LCPC, or equivalent counseling license; or PhD/PsyD in specified psychology fields; or MA/PhD in specified related fields • Relevant professional credential combined with at least 5 years of direct advisory, coaching, mediation, consulting, or client-facing experience • At least 3 years of relevant professional practice • Experience gathering missing context through interviews, assessments, consultations, or advisory conversations • Ability to distinguish critical information from non-essential context • Strong written English and qualitative analytical skills • Strong attention to detail and ability to follow detailed labeling guidelines • Full-time commitment of 40 hours per week with at least 4 hours of PST overlap • Successful completion of a short online test and delivery review

Apply Now