Lead Specialist, AI Scientist

Job not on LinkedIn

🕒 April 24

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Pearson VUE

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1994

📚 Education

🛍️ eCommerce

☁️ SaaS

Education • eCommerce • SaaS

Pearson VUE is a global leader in computer-based testing, providing a wide range of credentialing and certification exams for various industries. They support test-takers and test owners by offering resources, scheduling options, and accommodations to ensure equitable access to testing. Their mission is to empower candidates and enrich communities through the delivery of high-stakes exams that validate professional skills and knowledge, contributing to career advancement and industry standards.

📋 Description

• Design, build, and improve speech language models for spoken response understanding, pronunciation analysis, fluency, prosody, and communicative effectiveness. • Develop and evaluate automated scoring and feedback pipelines for speaking tasks used in: • AI‑driven speaking practice with instant feedback (learner‑facing). • Job‑relevant oral communication and soft‑skills assessments (hiring‑facing). • Train, fine‑tune, and evaluate acoustic models, cascading models, speech-to-speech models, speech LMs, and scoring models, including neural and large language model–based approaches. • Design experiments and conduct quantitative performance, reliability, and validity analyses to ensure assessment quality and decision integrity. • Work across a range of speaking constructs such as interactional competence, pragmatic competence, spoken critical thinking skills etc. • Perform detailed error analysis, intra- and inter-agent rater reliability studies on ASR outputs, spoken features, and scoring behaviors to guide model and product improvements. • Collaborate with product, UX, and assessment scientists to integrate models into interactive experiences such as practice simulations, and hiring workflows. • Apply responsible AI principles to speech systems, including fairness across accents, dialects, and proficiency levels, as well as transparency of feedback and scores. • Support model monitoring and governance in production environments, ensuring ongoing quality and compliance for high‑stakes use cases. • Act as the technical lead for an AI conversational assessment product, partnering closely with a Product Manager to translate assessment goals, user needs, and business constraints into model and system design decisions. • Shape end‑to‑end conversational assessment design (task structure, prompts, turn‑taking, scoring logic, feedback timing) in collaboration with product and assessment stakeholders. • Balance assessment validity, user experience, system latency, and scalability when making model and system design trade‑offs for production conversational assessments.

🎯 Requirements

• Master’s or PhD in Computer Science, Electrical Engineering, Speech & Language Processing, Applied Linguistics, Language Assessment, or equivalent applied experience. • Hands‑on experience building speech recognition, spoken language understanding, or automated scoring systems. • Strong programming skills in Python, with experience using PyTorch or similar ML frameworks for speech and language modeling. • Solid grounding in machine learning, statistics, and experimental design, especially as applied to model evaluation. • Experience with modern neural speech models and large language models, including fine‑tuning and evaluation for spoken tasks. • Expertise in model evaluation metrics relevant to speech and assessment (accuracy, reliability, validity, fairness). • Familiarity with responsible AI practices, including bias analysis, interpretability, and governance for user‑impacting systems. • Strong communication skills, with the ability to explain model behavior and assessment outcomes to technical and non‑technical stakeholders. • Experience working in cross‑functional product teams, contributing to roadmap decisions, and shipping ML systems into production.