AI Response Quality Evaluator – Gemini

🔥 0 minutes ago

🇦🇺 Australia – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Gramian Consulting

WebsiteLinkedInAll Job Openings

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Evaluate AI-generated responses using personalized prompts and information retrieved from connected Google applications. • Assess whether responses are relevant, accurate, helpful, and appropriately personalized. • Identify incorrect personalization, unsupported assumptions, irrelevant recommendations, and inconsistencies. • Compare multiple AI-generated responses and evaluate differences in overall user experience. • Provide clear, detailed, and well-reasoned feedback to support AI model improvements. • Follow project guidelines to ensure consistent and high-quality evaluations. • Review nuanced AI responses and identify strengths, weaknesses, and subtle quality issues. • Maintain data privacy and follow all confidentiality requirements throughout the project.

🎯 Requirements

• Currently based in Australia. • Willing and able to connect relevant Google apps to Gemini, subject to required consent and permissions. • Active use of Google applications, with sufficient personal data or history to support personalized retrieval evaluations. • Strong analytical thinking and attention to detail. • Excellent written English and ability to provide structured evaluation feedback. • Ability to work independently in a remote environment. • Access to a desktop or laptop with a reliable internet connection. • Bachelor’s degree or equivalent practical experience in any field.