AI Annotation Quality Reviewer

Job not on LinkedIn

🔥 0 minutes ago

🌐 United States, India, +1 more countries – Remote

🇺🇸 United States – Remote 🇮🇳 India – Remote 🇧🇷 Brazil – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Gramian Consulting

WebsiteLinkedInAll Job Openings

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Lead QA reviewers and manage audit and review queues to ensure timely and accurate completion of assigned work. • Spot-check annotated data and reviewer decisions to verify compliance with project guidelines and quality standards. • Provide clear, actionable, and consistent feedback to reviewers and annotators. • Conduct office hours and clarify annotation guidelines, review criteria, and quality expectations. • Monitor quality scores, error trends, audit results, and reviewer performance. • Train and onboard new reviewers on project guidelines, tools, and review procedures. • Identify recurring errors, inconsistencies, and process gaps, and recommend corrective actions. • Escalate persistent quality issues, unclear guidelines, and complex cases to the Senior QA Lead. • Support continuous improvement of review processes and maintain consistent quality across the team.

🎯 Requirements

• 3–5 years of overall professional experience, including at least 1 year of experience leading, mentoring, or supervising reviewers or team members. • Strong attention to detail and the ability to apply complex guidelines consistently. • Excellent written and verbal communication skills. • Ability to provide constructive, actionable feedback and explain quality expectations clearly. • Strong organizational skills and the ability to manage multiple review queues and competing deadlines. • Ability to identify patterns in errors and support corrective actions. • Availability to work the specified schedule for the full 16-week project.