Senior Marketing Strategy, AI Evaluation Specialist

🔥 2 minutes ago

🗽 New York – Remote

🗽 New York – Remote

💵 $55 - $75 / hour

⏰ Full Time

🟠 Senior

🤖 Artificial Intelligence

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

24-MAG

WebsiteLinkedInAll Job Openings

2 - 10 employees

🤝 B2B

💼 Consulting

B2B • Consulting

24-MAG is a commercial strategy and execution firm that helps B2B organizations design and implement systems, workflows, and operating rhythms for sales, client management, and cross-functional projects. They focus on transforming scattered processes into aligned, measurable, and scalable commercial functions—covering pipeline structure, account management frameworks, and operational discipline for teams seeking efficient, intentional growth.

📋 Description

• Guide research and engineering teams on brand strategy, growth marketing, performance marketing, and campaign-planning concepts • Identify gaps in model understanding across customer segmentation, positioning, channel strategy, creative development, and measurement • Apply practical marketing judgment to complex scenarios involving brands, audiences, markets, and commercial objectives • Ensure marketing tasks reflect realistic business decisions and professional standards • Design challenging, domain-relevant tasks grounded in real marketing practice • Write accurate, well-reasoned solutions covering brand, growth, campaign, and performance-marketing scenarios • Develop problems requiring strategic judgment, prioritisation, interpretation of data, and evaluation of trade-offs • Ensure tasks are clear, internally consistent, and suitable for structured assessment • Evaluate AI-generated marketing responses against established rubrics and scoring criteria • Assess correctness, strategic judgment, reasoning quality, relevance, and practical applicability • Compare alternative outputs and identify which response provides the stronger marketing recommendation • Document factual errors, unsupported assumptions, weak strategic logic, and incomplete analysis • Provide clear written feedback that supports improvements in model behaviour • Develop and refine evaluation guidelines for brand, growth, campaign, and performance-marketing tasks • Define scoring criteria for strategic quality, commercial judgment, reasoning, and execution feasibility • Participate in calibration activities with other marketing specialists • Collaborate across teams to maintain consistency and accuracy throughout the training data

🎯 Requirements

• US-based senior marketing professional • At least 8 years of dedicated professional experience in marketing • Senior-level expertise in brand strategy, growth marketing, performance marketing, campaign strategy, or related areas • Experience working within a recognised consumer brand, agency, technology company, or comparable organisation • Prior experience evaluating LLM or AI-generated outputs using structured rubrics or scoring criteria is required • Demonstrable career progression into senior manager, director, vice president, or comparable leadership responsibilities • Strong commercial judgment • Ability to evaluate complex marketing decisions • Excellent written and verbal communication skills • Reliable availability for at least 35 hours per week during weekdays • A degree in marketing, business administration, communications, economics, consumer psychology, or a related field is highly relevant • Graduate-level education in marketing, strategy, business, or management may be helpful • Equivalent senior professional experience in brand, growth, or performance marketing may also be considered • Professional training in analytics, market research, digital marketing, or AI evaluation may be valuable • Applicants should clearly describe relevant AI evaluation experience in their application • Immediate availability is preferred

🏖️ Benefits

• Full-time remote engagement • Competitive hourly compensation • W-2 contingent employment arrangement • Remote consulting opportunity • Immediate availability preferred • Work may include onboarding, specialty calibration, task development, and ongoing quality review