AI Voice Evaluation Specialist

Job not on LinkedIn

🕒 4 days ago

🇨🇦 Canada – Remote

💵 $20 - $25 / hour

⏳ Contract/Temporary

⚪️ Entry-level

🟢 Junior

🤖 Artificial Intelligence

Where this job comes from

Posted on InnoData's careers page ↗InnoData's careers page, not through a job board

First seen by Remote Rocketship 4 days ago

Still open on InnoData's site. Checked 1 minute ago.

Apply Now
Logo of InnoData

InnoData

2 - 10 employees

Founded 2019

🤝 B2B

💼 Consulting

🌍 Social Impact

B2B • Consulting • Social Impact

InnoData is INNOvation DATA SCS, an Italian social cooperative based in Foggia that identifies itself as a provider of technological solutions. The company website (currently under maintenance) highlights "Soluzioni tecnologiche" (technological solutions) and emphasizes social impact ("Impatto sociale"). Contact details listed include Via Francesco Crispi 65, 71121 Foggia, Italy. Based on the available information, InnoData appears to operate at the intersection of technology and social impact, likely offering tech-focused services to other organizations.

📋 Description

• Review an assigned scenario and roleplay a natural conversation with two different AI models. • Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible. • Maintain approximately the same number of conversational turns with each model to support a fair comparison. • Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses. • Evaluate each model across five defined evaluation dimensions. • Identify and categorize relevant error clusters that may occur in the audio or conversation. • Compare the performance of Model A and Model B based on the evaluation criteria and your observations. • Select the model that demonstrated the stronger overall performance according to the defined evaluation framework. • Write a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations. • Apply evaluation guidelines consistently across different scenarios and model interactions

🎯 Requirements

• Bachelors Degree • Strong attention to detail and ability to notice subtle differences in conversational quality. • Excellent listening and comprehension skills. • Strong written communication skills, particularly the ability to explain observations clearly and objectively. • Ability to consistently follow detailed evaluation guidelines. • Comfort speaking naturally and role-playing different conversational scenarios. • Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation. • Strong critical-thinking and analytical skills. • Reliability and consistency when completing structured evaluation tasks. • Familiarity with AI assistants, voice-based AI, or conversational systems

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 November 5

RWS Group

5001 - 10000

💼 Consulting

🏥 Healthcare

⚖️ Legal

French Canadian voice contributor recording natural speech for RWS’s AI evaluation project. Completing task-based recordings to improve speech and language technology.

🇨🇦 Canada – Remote

💵 $16 / hour

⏳ Contract/Temporary

⚪️ Entry-level

🟢 Junior

🤖 Artificial Intelligence

🚫👨‍🎓 No degree required

🗣️🇫🇷 French Required

🕒 October 20

Volga Partners

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Medical AI Evaluator reviewing clinical scenarios and AI-generated healthcare content for Volga Partners. Applying medical education and evidence-based reasoning to improve healthcare AI accuracy.

🇨🇦 Canada – Remote

💵 $15 - $35 / hour

⏳ Contract/Temporary

⚪️ Entry-level

🟢 Junior

🤖 Artificial Intelligence

🚫👨‍🎓 No degree required

🕒 October 6

RWS Group

5001 - 10000

💼 Consulting

🏥 Healthcare

⚖️ Legal

AI Linguistic Evaluator assessing Marathi AI-generated content for RWS. Evaluating translation, linguistic accuracy, localization, and cultural relevance remotely from Canada.

🕒 August 14

Welo Global

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Generative AI Analyst validating Canadian French translations for Welo Data, a global AI data company. Reviewing and annotating multilingual AI-generated content for training and quality improvement.

🇨🇦 Canada – Remote

💵 $20 / hour

⏳ Contract/Temporary

⚪️ Entry-level

🟢 Junior

🤖 Artificial Intelligence

🚫👨‍🎓 No degree required

🗣️🇫🇷 French Required

🕒 February 26

LILT AI

201 - 500

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

AI Data Experts supporting AI training projects including prompt evaluation and video content understanding. Seeking detail-oriented candidates with native-level fluency in Canadian French.

🇨🇦 Canada – Remote

🔥 Funding within the last year

💰 $25M Funding Round - LILT on 2025-06

⏳ Contract/Temporary

⚪️ Entry-level

🟢 Junior

🤖 Artificial Intelligence

🚫👨‍🎓 No degree required

🗣️🇫🇷 French Required

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok