AI Evaluator – Shopping Assistant

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $50 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 0%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Terac

Terac

1 - 10 employees

Founded 2025

🤖 Artificial Intelligence

🤝 B2B

Artificial Intelligence • B2B • Market Research

Terac is automating market research by sourcing participants, conducting interviews, and analyzing results in hours rather than weeks. Utilizing advanced AI technology, it enables companies to gain deep insights through interviews with a diverse audience. Terac emphasizes efficiency and speed in delivering comprehensive market research solutions, making it an invaluable tool for businesses seeking rapid feedback and data-driven decision-making.

📋 Description

• Review real user interaction traces with an AI shopping assistant • Identify logical failures, inaccuracies, or poor product recommendations in text • Create structured rubrics and verifiers to judge response quality • Commit to 20+ hours per week of evaluation work on the internal platform • Provide analysis that improves the underlying AI model and response quality

🎯 Requirements

• Experience in data evaluation, quality assurance, or AI training • Strong analytical skills with the ability to spot subtle errors in text • Familiarity with e-commerce search and digital shopping experiences • Prior experience in prompt engineering, complex data annotation, or software testing welcomed • Ability to commit to a sustained workload of 20+ hours per week • Comfortable analyzing text interactions deeply and building structured evaluation frameworks from scratch

🏖️ Benefits

• Paid interview • Remote work arrangement • Ongoing engagement • 20+ hours per week of paid evaluation work

Apply Now

Similar Jobs

🔥 9 hours ago

Mercor

51 - 200

Field marketing expert designing realistic simulated work environments for Mercor’s AI-agent training projects. Creating rubrics, reviewing agent attempts, and evaluating field marketing decisions.

🇺🇸 United States – Remote

💵 $60 - $100 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 13 hours ago

Ecoer

51 - 200

⚡ Energy

🏭 Manufacturing

Independent sales representative introducing Mermaid AI’s AI-powered radio platform to fire and police agencies. Conducting field demonstrations, managing full-cycle sales, and building municipal relationships.

🔥 17 hours ago

Mercor

51 - 200

AI Safety Red Teamer identifying vulnerabilities in frontier AI models for Mercor’s AI training projects. Designing adversarial prompts and evaluating high-risk model behavior.

🇺🇸 United States – Remote

💵 $70 - $84 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 17 hours ago

Mercor

51 - 200

AI Safety Red Teamer identifying vulnerabilities in frontier AI systems for Mercor. Designing adversarial tests and improving model alignment, robustness, and safety.

🇺🇸 United States – Remote

💵 $70 - $84 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 17 hours ago

Mercor

51 - 200

AI safety red teamer probing conversational models for Mercor’s frontier AI training projects. Generating reproducible vulnerability data to strengthen customer AI systems.

🇺🇸 United States – Remote

💵 $20 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence