Data Science, Quantitative AI Evaluation Specialist

🔥 12 hours ago

🌐 United States, Canada, +3 more countries – Remote

infoinfo

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

📊 Data Scientist

👻 Ghost score 12%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Gramian Consulting

Gramian Consulting

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Evaluate AI-generated outputs across data science, statistics, machine learning, experimentation, and quantitative problem-solving • Create expert-level prompts, datasets, and reference solutions for AI training and evaluation • Identify flawed methodologies, statistical inaccuracies, unsupported assumptions, and weaknesses in quantitative reasoning • Assess the correctness, reliability, and clarity of analytical approaches and conclusions • Provide structured, evidence-based feedback to help improve AI model capabilities • Apply consistent evaluation criteria and communicate technical findings clearly

🎯 Requirements

• At least one year of experience working at a top company (tech, finance, or research), and 3 years of experience (overall) working in DS/SWE • Bachelor’s degree in Data Science, Software Engineering, or a related field from a university in the United States, Canada, Australia, New Zealand, or the United Kingdom • Foundational knowledge of data science, statistics, machine learning, or quantitative analysis • Strong analytical and critical-thinking skills, with the ability to identify errors in data-driven reasoning • Excellent written English and the ability to explain technical and statistical concepts clearly • Ability to evaluate complex problems systematically and provide accurate, well-supported feedback • Current residence in an English-speaking country

Apply Now

Similar Jobs

🕒 4 days ago

ACT

501 - 1000

📚 Education

🤝 Non-profit

Data Scientist II building personalized college, career, and pathway recommendations at ACT. Developing fair, explainable models and production data pipelines for student navigation.

🕒 5 days ago

Mercor

51 - 200

Data Science Expert evaluating AI-generated slides, spreadsheets, and documents for Mercor. Providing structured feedback to help train and enhance frontier AI systems.

🇺🇸 United States – Remote

💵 $100 - $150 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

📊 Data Scientist

🕒 October 1

Red Pico

1 - 10

💼 Consulting

📣 Marketing

📦 Logistics

Microsoft Fabric/Azure Data Lead modernizing Bollinger Shipyards’ enterprise data platform. Leading Synapse migration, secure ingestion, architecture, and data engineering delivery.

🕒 September 25

Mercor

51 - 200

Data Science Expert reviewing AI-generated slides, spreadsheets, and documents for Mercor. Grading usability, accuracy, aesthetics, and presentation quality to improve frontier AI systems.

🇺🇸 United States – Remote

💵 $100 - $150 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

📊 Data Scientist

🕒 September 25

Priorities USA

51 - 200

💼 Consulting

📣 Marketing

📦 Logistics

Data Scientist contractor prototyping LLM applications and statistical tools for Priorities USA’s digital voter mobilization campaigns. Engineering validated methods into production-ready data pipelines and applications.