AI Personalization Rater

🔥 0 minutes ago

🇨🇦 Canada – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 12%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Gramian Consulting

Gramian Consulting

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Evaluate AI-generated responses using personalized prompts and information retrieved from connected Google applications. • Assess whether responses are relevant, accurate, helpful, and appropriately personalized. • Identify incorrect personalization, unsupported assumptions, irrelevant recommendations, and inconsistencies. • Compare multiple AI-generated responses and assess their overall user experience. • Provide clear, detailed, and well-reasoned evaluation feedback. • Follow project guidelines to ensure consistent and high-quality ratings. • Identify subtle strengths and weaknesses in AI-generated responses. • Maintain data privacy and comply with project confidentiality requirements.

🎯 Requirements

• Currently based in Canada. • Willing and able to connect relevant Google applications to Gemini, subject to required permissions and consent. • Active use of Google Workspace or consumer Google apps, with sufficient personal data or history to support personalized retrieval evaluations. • Strong analytical thinking and attention to detail. • Excellent written English and ability to provide structured feedback. • Ability to work independently in a remote environment. • Access to a desktop or laptop with a reliable internet connection. • Bachelor’s degree or equivalent practical experience in any field.

Apply Now

Similar Jobs

🕒 September 8

LILT AI

201 - 500

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

AI benchmark engineer building French-Canadian Terminal-Bench coding evaluations for LILT. Creating multilingual datasets, prompts, reference implementations, and verifier scripts for AI models.

🇨🇦 Canada – Remote

💰 $25M Funding Round - LILT on 2025-06

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🗣️🇫🇷 French Required

🕒 August 14

Welo Global

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

Generative AI Analyst validating Canadian French translations for Welo Data, a global AI data company. Reviewing and annotating multilingual AI-generated content for training and quality improvement.

🗣️🇫🇷 French Required

🕒 August 11

Clarius Mobile Health

51 - 200

🏭 Manufacturing

🏥 Healthcare

🧬 Biotechnology

Regulatory Specialist supporting AI/ML medical-device strategies and submissions at Clarius Mobile Health, an affordable connected-ultrasound company. Creating DHF, model-validation, data, and compliance documentation for Canada, FDA, and EU pathways.

🇨🇦 Canada – Remote

💵 $85k - $105k / year

💰 $6.3M Venture Round on 2018-05

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🕒 July 29

Volga Partners

1001 - 5000

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Evaluate and annotate AI-generated responses while providing structured feedback. Collaborate with teams and clients to maintain high-quality standards in AI performance.

🗣️🇮🇹 Italian Required

🕒 February 26

LILT AI

201 - 500

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

AI Data Experts supporting AI training projects including prompt evaluation and video content understanding. Seeking detail-oriented candidates with native-level fluency in Canadian French.

🇨🇦 Canada – Remote

💰 $25M Funding Round - LILT on 2025-06

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🗣️🇫🇷 French Required