AI Quality Assurance Analyst

🔥 14 hours ago

🇺🇸 United States – Remote

💵 $100k - $110k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 QA Engineer (Quality Assurance)

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

OneDigital

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2000

💸 Finance

👥 HR Tech

Insurance • Finance • HR Tech

OneDigital is a company that specializes in providing insurance, financial services, and HR consulting solutions. By leveraging technology and innovation, OneDigital aims to transform complex and inefficient landscapes through business automation, APIs, product development, and AI. Their services include employee benefits consulting, property and casualty insurance, retirement plan administration, and wealth management. OneDigital is committed to diversity, equity, inclusion, and belonging within its corporate culture and offers a range of services aimed at helping businesses and individuals achieve their aspirations of health, success, and financial security.

📋 Description

• Design and execute test plans for AI-powered applications across both output quality and functional behavior • Evaluate AI responses for accuracy, consistency, hallucination, and edge case handling • Test application workflows, UI behavior, and integrations across internal and client-facing tools • Identify, document, and track defects using standard issue tracking tools (e.g., Jira or equivalent) • Partner with AI Builders and Product Managers to define acceptance criteria and quality standards for AI features • Develop and maintain repeatable test cases and QA documentation as AI applications evolve • Conduct regression testing as applications are updated or new features are released • Collaborate with the Principal Engineer and product team to surface quality risks early in the build process • Contribute to defining what “good” looks like for AI output quality at OneDigital, helping shape internal QA standards for LLM-based applications • Support testing across multiple business lines including Employee Benefits, Retirement, Wealth, and P&C

🎯 Requirements

• Experience in a QA, testing, or quality-focused role, with some exposure to AI or LLM based products preferred • Strong ability to evaluate AI-generated outputs for quality, accuracy, and appropriateness • Familiarity with prompt-driven systems and an intuition for how language models can fail or produce unexpected results • Experience writing and executing test cases and documenting defects clearly • Comfort working in no-code and low-code environments • Strong written communication skills, with the ability to describe issues precisely and concisely • Curiosity and adaptability in a fast-moving, emerging technology space • Ability to work independently and manage multiple testing workstreams at once

🏖️ Benefits

• Health, wellbeing, retirement, and other financial benefits • Paid time off • Overtime pay for non-exempt employees • Robust learning and development programs • Reimbursement of job-related expenses per company policy • Employee perks and discounts