MCP & AI Connector Evaluation Specialist

Job not on LinkedIn

🕒 July 27

🗽 New York – Remote

🗽 New York – Remote

💵 $45 - $185 / hour

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🤖 Artificial Intelligence

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

24-MAG

WebsiteLinkedInAll Job Openings

2 - 10 employees

🤝 B2B

💼 Consulting

B2B • Consulting

24-MAG is a commercial strategy and execution firm that helps B2B organizations design and implement systems, workflows, and operating rhythms for sales, client management, and cross-functional projects. They focus on transforming scattered processes into aligned, measurable, and scalable commercial functions—covering pipeline structure, account management frameworks, and operational discipline for teams seeking efficient, intentional growth.

📋 Description

• Create realistic prompts involving complex, high-context personal tasks • Develop scenarios across travel, health research, dining, activity planning, home services, career search, and personal organisation • Incorporate genuine preferences, constraints, trade-offs, and success criteria • Design tasks requiring planning, judgment, context retention, and connected-tool usage • Use MCP-enabled tools, plugins, and connectors to complete multi-step workflows • Test integrations involving Google Drive, Notion, travel services, and similar platforms • Evaluate whether AI systems select and use connected tools appropriately • Complete assigned workflows while recording the screen • Clearly demonstrate the actions, tools, and decisions involved in each task • Document where the AI succeeds, overreaches, misses context, or produces impractical results • Judge whether outputs are personalised, realistic, useful, safe, and well-reasoned • Create detailed scoring rubrics for complex personal-assistant tasks

🎯 Requirements

• Advanced practical experience using MCP, plugins, and AI connectors • Frequent use of connected LLM tools, ideally several times per week • Heavy personal use of AI for planning, research, organisation, and decision-making • An active LLM account with approximately 6 months or more of regular usage history • Experience using AI for high-context, multi-step personal workflows • Strong written judgment, reasoning, and attention to detail • Ability to explain clearly why an AI output is effective, incomplete, unsafe, or unrealistic • Experience designing and applying structured evaluation rubrics • Availability to contribute at least 20 hours per week • Ability to complete assigned tasks within approximately 24 hours

🏖️ Benefits

• Competitive rates between $45–$185 per hour depending on expertise, task complexity, and project scope • Weekly payments via Stripe or Wise