Finance Domain AI Evaluator, AI Quality Analyst

Job not on LinkedIn

🔥 1 minute ago

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Volga Partners

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2020

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Volga Partners is a technology services firm that specializes in Artificial Intelligence and Machine Learning solutions, data annotation and labeling, and development of customer service platforms powered by generative AI. The company also provides IT and software development services across web, app, full-stack, cybersecurity advisory, and e-commerce support, supported by a large multilingual crowd workforce and remote on-demand resources. Volga Partners focuses on partnering with enterprise clients to deliver scalable, cost-effective AI tooling, content moderation, linguistic services, and managed software projects.

📋 Description

• Apply finance expertise to assess the performance of advanced Large Language Models (LLMs) by creating realistic finance-related scenarios. • Develop expert reference answers and evaluate AI-generated responses against defined quality standards. • Create realistic, finance-focused prompts and scenarios that reflect real-world professional challenges. • Develop tasks across multiple finance-related areas such as Financial Analysis, Corporate Finance, Accounting, Investment Analysis, Equity Research, Banking, Risk Management, and Valuation. • Ensure tasks accurately represent professional finance workflows and decision-making processes. • Develop high-quality reference answers that demonstrate finance expertise and provide clear reasoning, calculations, assumptions, and conclusions. • Review and evaluate AI-generated responses from LLMs using structured evaluation criteria. • Analyze model outputs for accuracy, quality, relevance, and compliance with professional finance standards. • Provide detailed feedback to support AI model evaluation, benchmarking, and continuous improvement efforts.

🎯 Requirements

• Bachelor's degree or higher in Finance, Accounting, Economics, Business Administration, Banking, Investment Management, or a related field. • Professional experience in finance, accounting, investment banking, corporate finance, equity research, auditing, or related areas. • Strong understanding of financial concepts, terminology, valuation methodologies, and analytical frameworks. • Ability to analyze and evaluate complex financial information. • Strong attention to detail and ability to maintain consistency in quality assessments. • Excellent written and verbal English communication skills. • Ability to follow structured guidelines, evaluation frameworks, and quality standards. • Comfortable working independently in a task-based environment. • Availability to commit to a full-time schedule of 40 hours per week. • Experience in Investment Banking, Equity Research, Financial Modeling, Valuation, Corporate Finance, M&A, or Capital Markets (preferred). • CFA Charterholder or CFA Candidate actively pursuing the CFA designation (preferred). • Experience in financial modeling, valuation, investment research, auditing, risk analysis, or corporate finance (preferred). • Familiarity with Generative AI, Large Language Models (LLMs), or AI-powered tools (preferred). • Previous experience in quality assurance, content evaluation, annotation, auditing, or benchmarking projects (preferred). • Experience developing assessment frameworks, scoring rubrics, or evaluation criteria (preferred). • Professional certifications such as CFA, ACCA, CPA, CMA, FRM, CFP, or CA (preferred).