Government Subject Matter Expert, AI Model Evaluation

🔥 1 hour ago

🇺🇸 United States – Remote

💵 $35 - $40 / hour

⏳ Contract/Temporary

🟢 Junior

🟡 Mid-level

🤖 Artificial Intelligence

🚫👨‍🎓 No degree required

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 3%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Volga Partners

Volga Partners

1001 - 5000 employees

Founded 2020

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Volga Partners is a technology services firm that specializes in Artificial Intelligence and Machine Learning solutions, data annotation and labeling, and development of customer service platforms powered by generative AI. The company also provides IT and software development services across web, app, full-stack, cybersecurity advisory, and e-commerce support, supported by a large multilingual crowd workforce and remote on-demand resources. Volga Partners focuses on partnering with enterprise clients to deliver scalable, cost-effective AI tooling, content moderation, linguistic services, and managed software projects.

📋 Description

• Evaluate AI-generated responses for accuracy, completeness, reasoning, and regulatory alignment • Apply expert judgment to determine whether AI-generated conclusions are appropriate, defensible, and supported by policies or regulations • Identify inaccurate interpretations, flawed assumptions, missing information, and compliance concerns • Validate findings against statutes, regulations, agency guidance, and professional standards • Develop evaluation benchmarks, reference responses, assessment criteria, and examples of sound professional reasoning • Provide actionable feedback and recommend improvements to AI-generated content • Apply project-specific evaluation guidelines and participate in quality reviews • Help improve the accuracy and reliability of AI-generated information for public-sector challenges

🎯 Requirements

• At least 2 years of relevant professional experience in government operations, public administration, regulatory compliance, government procurement, or a closely related field • Demonstrated subject matter expertise in at least one government specialization • Experience interpreting, evaluating, auditing, or applying government policies, regulations, or professional standards • Strong analytical reasoning and ability to identify inaccuracies, inconsistencies, and unsupported conclusions • Excellent written communication skills, including ability to explain complex findings clearly and concisely • Ability to conduct independent research and validate information using authoritative sources • Comfort using digital platforms, online research tools, and structured evaluation guidelines • Current U.S. residency and ability to work independently in a remote, project-based environment • Successful completion of a skills-based assessment • Availability may be needed on weekdays or weekends • Experience with AI model evaluation, LLMs, research, or structured quality assessments is beneficial but not required

🏖️ Benefits

• Remote, project-based flexibility • Opportunities for future engagements based on project availability and performance

Apply Now

Similar Jobs

🔥 14 hours ago

Pado

1 - 10

🤖 Artificial Intelligence

⚡ Energy

☁️ SaaS

Reserved GPU deal broker matching AI compute supply and demand for PADO’s LG-backed marketplace. Structuring pricing, margins, contracts, and capacity commitments for AI-native buyers.

🔥 21 hours ago

Mercor

51 - 200

AI red-team contractor probing Mercor partner models for jailbreaks, bias, and vulnerabilities. Generating structured human data to improve AI safety and reliability.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 21 hours ago

Mercor

51 - 200

AI Safety Specialist evaluating English conversations and AI responses. Providing structured feedback to help Mercor train and enhance frontier AI systems.

🇺🇸 United States – Remote

💵 $30 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 21 hours ago

Mercor

51 - 200

AI safety specialist evaluating English conversations and labeling AI responses. Supporting Mercor’s partnerships with AI labs to train and enhance frontier models.

🇺🇸 United States – Remote

💵 $30 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

🔥 21 hours ago

Mercor

51 - 200

AI safety red-teamer probing frontier models for jailbreaks, bias, and vulnerabilities at Mercor. Generating structured human data, attack cases, and reproducible safety reports.

🇺🇸 United States – Remote

💵 $16 - $22 / hour

🔥 Funding within the last year

💰 $350M Series C - Mercor on 2025-10

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence