AI Voice Evaluation Specialist

Job not on LinkedIn

🕒 October 14

🇺🇸 United States – Remote

💵 $20 - $25 / hour

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 20%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

InnoData

WebsiteLinkedInAll Job Openings

2 - 10 employees

Founded 2019

🤝 B2B

💼 Consulting

🌍 Social Impact

B2B • Consulting • Social Impact

InnoData is INNOvation DATA SCS, an Italian social cooperative based in Foggia that identifies itself as a provider of technological solutions. The company website (currently under maintenance) highlights "Soluzioni tecnologiche" (technological solutions) and emphasizes social impact ("Impatto sociale"). Contact details listed include Via Francesco Crispi 65, 71121 Foggia, Italy. Based on the available information, InnoData appears to operate at the intersection of technology and social impact, likely offering tech-focused services to other organizations.

📋 Description

• Review an assigned scenario and roleplay a natural conversation with two different AI models • Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible • Maintain approximately the same number of conversational turns with each model to support a fair comparison • Record your voice during each interaction and assess the quality and behavior of the models' responses • Evaluate each model across five defined evaluation dimensions • Identify and categorize relevant error clusters in the audio or conversation • Compare Model A and Model B based on the evaluation criteria and observations • Select the model demonstrating stronger overall performance • Write a detailed rationale explaining the final preference with specific examples and observations • Apply evaluation guidelines consistently across scenarios and model interactions

🎯 Requirements

• Bachelor's degree • Strong attention to detail and ability to notice subtle differences in conversational quality • Excellent listening and comprehension skills • Strong written communication skills, particularly the ability to explain observations clearly and objectively • Ability to consistently follow detailed evaluation guidelines • Comfort speaking naturally and role-playing different conversational scenarios • Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation • Strong critical-thinking and analytical skills • Reliability and consistency when completing structured evaluation tasks • Familiarity with AI assistants, voice-based AI, or conversational systems

🏖️ Benefits

• W2 employment • Full-time contract for 3 months • 40 hours per week

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume