AI Voice Evaluation Specialist

Job not on LinkedIn

🔥 0 minutes ago

🏈 Alabama, Alaska, +8 more states – Remote

infoinfo

💵 $20 - $27 / hour

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 20%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of InnoData

InnoData

2 - 10 employees

Founded 2019

🤝 B2B

💼 Consulting

🌍 Social Impact

B2B • Consulting • Social Impact

InnoData is INNOvation DATA SCS, an Italian social cooperative based in Foggia that identifies itself as a provider of technological solutions. The company website (currently under maintenance) highlights "Soluzioni tecnologiche" (technological solutions) and emphasizes social impact ("Impatto sociale"). Contact details listed include Via Francesco Crispi 65, 71121 Foggia, Italy. Based on the available information, InnoData appears to operate at the intersection of technology and social impact, likely offering tech-focused services to other organizations.

📋 Description

• Review an assigned scenario and roleplay a natural conversation with two different AI models. • Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible. • Maintain approximately the same number of conversational turns with each model to support a fair comparison. • Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses. • Evaluate each model across five defined evaluation dimensions. • Identify and categorize relevant error clusters that may occur in the audio or conversation. • Compare the performance of Model A and Model B based on the evaluation criteria and your observations. • Select the model that demonstrated the stronger overall performance according to the defined evaluation framework. • Write a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations. • Apply evaluation guidelines consistently across different scenarios and model interactions

🎯 Requirements

• Bachelors Degree • Strong attention to detail and ability to notice subtle differences in conversational quality. • Excellent listening and comprehension skills. • Strong written communication skills, particularly the ability to explain observations clearly and objectively. • Ability to follow detailed evaluation guidelines consistently. • Comfort speaking naturally and roleplaying different conversational scenarios. • Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation. • Strong critical-thinking and analytical skills. • Reliability and consistency when completing structured evaluation tasks. • Familiarity with AI assistants, voice-based AI, or conversational systems

Apply Now

Similar Jobs

🔥 11 hours ago

Donato Technologies, Inc.

201 - 500

💼 Consulting

📣 Marketing

📦 Logistics

Chinese-speaking AI Quality Analyst evaluating personalized responses for a leading AI technology company. Creating prompts, reviewing accuracy, detecting hallucinations, and providing detailed rationales.

🗣️🇨🇳 Chinese Required

🔥 15 hours ago

Bidgely

51 - 200

⚡ Energy

🤖 Artificial Intelligence

☁️ SaaS

AI transformation catalyst advancing Bidgely’s clean-energy SaaS products through marketing, growth strategy, or new-product launches. Building AI workflows and measurable business outcomes.

🇺🇸 United States – Remote

💵 $130k - $160k / year

💰 $18M Venture Round - Bidgely on 2023-07

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 16 hours ago

Egnyte

1001 - 5000

💼 Consulting

🏥 Healthcare

🏗️ Construction

Senior AI Services Consultant building custom agents, workflows, and MCP integrations for Egnyte’s secure multi-cloud content platform. Advising enterprise customers on AI architecture and value realization.

🇺🇸 United States – Remote

💵 $125k - $140k / year

💰 Private Equity Round - Egnyte on 2025-02

⏰ Full Time

🟠 Senior

🤖 Artificial Intelligence

🔥 19 hours ago

Reveleer

51 - 200

🏥 Healthcare

⚕️ Healthcare Insurance

☁️ SaaS

Data Integration Analyst building healthcare data pipelines, algorithms, and semantic datasets for Reveleer’s risk-adjustment platform. Transforming messy customer data into AI-ready assets.

🔥 20 hours ago

HubSpot

1001 - 5000

🤝 B2B

☁️ SaaS

📣 Marketing

Lead AI-powered customer automation marketing at HubSpot, an AI-powered customer platform. Design personalized journeys, experiments, and communications that help businesses grow.