Senior QA Automation Engineer, AI Systems

Job not on LinkedIn

🕒 Yesterday

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Software Mind

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1999

🤖 Artificial Intelligence

☁️ SaaS

📡 Telecommunications

💰 Private Equity Round on 2020-12

Artificial Intelligence • SaaS • Telecommunications

Software Mind is a technology company that specializes in software development and digital transformation services. With a focus on AI and cloud solutions, the company offers a wide range of services including custom software development, mobile app development, and cloud consulting. Software Mind serves various industries such as financial services, telecom, biotech, and media, providing tailored solutions to accelerate digital transformations and business growth globally.

📋 Description

• Design and implement the validation harness for RAG output quality: retrieval accuracy, citation correctness, and grounding • Build automated test suites for the AI Extraction Gateway across Simple RAG and Complex RAG implementations • Develop and execute accuracy rubric test cases in collaboration with the BA and Designated Subject Matter Expert • Automate regression testing for confidence score calibration and source weighting behaviour • Test RBAC enforcement and role-specific filtered view access controls • Validate audit logging completeness and document lifecycle traceability • Build and maintain the incremental ingestion pipeline test suite • Contribute to go/no-go decision packs: produce accuracy reports and test evidence documentation

🎯 Requirements

• 6+ years in QA automation engineering; senior seniority required • Strong test automation engineering skills • Python preferred (pytest or equivalent framework) • Experience with API testing and contract testing • Comfortable designing test frameworks for non-deterministic or probabilistic systems • Experience in agile/scrum environments with Jira-based test management

🏖️ Benefits

• Flexible work arrangements