AI Evaluator, Gemini

🔥 9 minutes ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Gramian Consulting

Gramian Consulting

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Review, label, classify, and validate data according to detailed project guidelines • Ensure accuracy, consistency, and quality across assigned tasks • Apply instructions objectively when evaluating or categorizing content • Identify edge cases, discrepancies, and annotation issues • Escalate unclear or inconsistent cases when needed • Perform quality checks and provide clear feedback where required • Meet productivity and quality expectations in a remote work environment • Work independently while following project standards and timelines • Support AI model improvement through structured data tasks used to train and evaluate the Gemini model

🎯 Requirements

• Candidates must be in the US and eligible for 1099 contract • Candidates must be students, graduates, or recent graduates • Candidates must have at least 20 recent chat sessions with Gemini • Candidates must feel comfortable sharing their Gemini history for the purpose of the project • Commitment of 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST

🏖️ Benefits

• Remote work • Short-term freelance/contractor assignment

Apply Now

Similar Jobs

🔥 4 hours ago

Mercor

51 - 200

AI safety expert red-teaming conversational AI models for Mercor’s frontier-model training projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 4 hours ago

Mercor

51 - 200

AI red-teaming experts probing conversational models for Mercor, which helps AI labs train frontier systems. Testing vulnerabilities and producing reproducible safety data in English and Bengali.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 4 hours ago

Mercor

51 - 200

AI red-team expert probing conversational models for Mercor’s human-powered frontier AI training. Testing vulnerabilities, annotating failures, and producing reproducible safety datasets.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 4 hours ago

Mercor

51 - 200

AI red-teaming contractor probing conversational models for Mercor’s human-data AI safety projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 4 hours ago

Mercor

51 - 200

AI red-team contractor probing conversational models for Mercor, which helps AI labs and enterprises train frontier systems. Testing jailbreaks, vulnerabilities, and harmful behaviors through structured human data.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence