AI Operations Analyst

Job not on LinkedIn

🕒 April 9

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Shyft6

WebsiteLinkedInAll Job Openings

201 - 500 employees

Founded 2019

👥 HR Tech

🎯 Recruiter

🤝 B2B

HR Tech • Recruitment • B2B

Shyft6 is a trusted partner for innovative companies, specializing in workforce solutions that encompass staffing and recruiting, workforce management, and human capital strategy. With over 26 years of combined experience, Shyft6 offers a comprehensive range of services including contingent workforce supplier management, recruitment process outsourcing, staff augmentation, executive search, and multi-state payroll. Their focus is on empowering organizations through effective workforce development and project management, ensuring successful delivery and skilled talent acquisition.

📋 Description

• Monitor AI-driven workflows in production for abnormal behavior, trust issues, degraded outputs, and recurring exception patterns. • Review signals related to output quality, fallback use, low-confidence patterns, and workflow anomalies. • Escalate issues that could affect live user trust, business quality, or finance-sensitive outcomes. • Support investigation of output-quality incidents, orchestration failures, prompt or workflow regressions, and tool-call problems in production. • Help distinguish true software defects from model behavior issues, data-quality problems, or process misunderstandings. • Partner closely with Engineering, QA, and business stakeholders on judgment-heavy incidents. • Support human-review patterns, fallback routes, and safe-operating responses for AI-enabled features. • Help define and apply production review practices for higher-risk workflows. • Document evidence and issue patterns in ways that support repeatability and better release decisions. • Identify recurring AI operations issues and recommend improvements to supportability, monitoring, and quality feedback loops. • Feed production learnings back into QA, Product, and Engineering. • Help improve operational trust in AI-enabled solutions over time.

🎯 Requirements

• 4+ years of experience in production support, AI operations, business process operations, analytics, QA, or a similar role. • Strong analytical skills and comfort evaluating nuanced workflow or output issues. • Ability to work across engineering and business teams in ambiguous situations. • Experience with AI-enabled workflows, operational analytics, business process validation, or support for workflow-heavy systems. • Strong written communication and documentation discipline. • Bachelor's degree preferred.

🏖️ Benefits

• Base salary plus performance-based bonus