LLM AI Quality Analyst

Job not on LinkedIn

🔥 26 minutes ago

🏈 Alabama, Arizona, +20 more states – Remote

🏈 Alabama – Remote 🌵 Arizona – Remote ⛰️ Colorado – Remote 🐊 Florida – Remote 🥔 Idaho – Remote 🌾 Iowa – Remote 🐎 Kentucky – Remote 🦬 Montana – Remote 🗽 New York – Remote 🌲 North Carolina – Remote 🌾 North Dakota – Remote 🌪️ Oklahoma – Remote 🚗 Michigan – Remote ❄️ Minnesota – Remote 🎸 Mississippi – Remote 🏰 Missouri – Remote 🔔 Pennsylvania – Remote 🌴 South Carolina – Remote 🗿 South Dakota – Remote ⚔️ Virginia – Remote 🧀 Wisconsin – Remote 🦬 Wyoming – Remote

💵 $15 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Donato Technologies, Inc.

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2012

💼 Consulting

📣 Marketing

📦 Logistics

Consulting • Marketing • Logistics

Donato Technologies, Inc. is a Dallas-based IT services firm that delivers advanced technology solutions, strategic direction, and staffing to businesses. The company provides project-based and ongoing services such as job order and crew maintenance, billing and financing systems, customer data management, quality control, and dispatch & logging solutions. Donato Technologies focuses on helping organizations modernize IT processes and implement practical technology strategies to drive operational efficiency and growth.

📋 Description

• Evaluate personalized AI/Gemini responses • Create and test multi-turn prompts • Assess AI responses for Grounding, Integration, and Helpfulness • Compare model responses side-by-side • Identify incorrect personalization, poor inferences, and hallucinations • Provide detailed feedback and rationales

🎯 Requirements

• Bachelor’s or Master’s degree in IT or any IT-related field • Strong English reading and writing skills • Strong analytical and attention-to-detail skills • AI evaluation, data annotation, content moderation, or related experience preferred • Ability to work independently in a remote environment • Laptop/Desktop with reliable internet • Willingness to use a primary personal Google account and enable personal data sources for the assessment • Availability of 30–40 hours per week • Availability during PST hours with 4 hours of overlap required • Must be located in one of the approved states: Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, or Wyoming • Strong English language skills

🏖️ Benefits

• Flexible remote work arrangement • Monthly pay for contract employees • Medical benefits • Vision benefits • Flexible spending account for medical and dependent care • Dental benefits • Paperless pay statements • Text message updates about the application