Business Analyst – AI Response Evaluation Specialist

Job not on LinkedIn

🔥 0 minutes ago

🇺🇸 United States – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🧐 Business Analyst

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Gramian Consulting

WebsiteLinkedInAll Job Openings

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Gather, analyze, and document business requirements, stakeholder expectations, and project objectives. • Compare multiple chatbot responses and assess their accuracy, relevance, completeness, and alignment with defined evaluation criteria. • Conduct structured evaluations and provide clear, evidence-based final assessments of AI-generated outputs. • Translate business requirements into functional specifications, evaluation criteria, and actionable documentation. • Analyze workflows, business processes, and data to identify gaps, inefficiencies, and improvement opportunities. • Create reports, dashboards, process maps, and other project documentation. • Support project planning, testing, implementation, and user acceptance testing (UAT). • Collaborate with technical teams and business stakeholders to ensure project requirements are understood and met. • Track project progress, risks, dependencies, and key performance indicators (KPIs). • Present findings, insights, and recommendations to support informed decision-making. • Maintain consistent evaluation quality and meet project deadlines and task completion targets.

🎯 Requirements

• Bachelor's degree in Business Administration, Finance, Computer Science, or a related field. • At least 3 years of professional experience as a Business Analyst or in a similar analytical role. • Strong analytical thinking, problem-solving, and decision-making skills. • Proficiency in Excel and experience with SQL, Power BI, Tableau, or comparable analytical and reporting tools. • Experience gathering requirements, documenting functional specifications, and mapping business processes. • Strong attention to detail and the ability to compare complex information against defined criteria. • Excellent written communication, reporting, and documentation skills. • Ability to collaborate with cross-functional teams and manage multiple priorities independently. • Willingness to work five days per week, including weekends when required, with two weekdays off during the project.