Senior Testing Engineer

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Robots & Pencils

WebsiteLinkedInAll Job Openings

51 - 200 employees

🤖 Artificial Intelligence

🤝 B2B

☁️ SaaS

💰 Venture Round on 2022-04

Artificial Intelligence • B2B • SaaS

Robots & Pencils is a digital innovation firm that specializes in developing digital strategies and products utilizing mobile, web, and frontier technologies to drive transformation for businesses. They focus on areas such as mobile development, product design, UX research, artificial intelligence, machine learning, and organizational change management. With a commitment to blending creativity with technology, they aim to unlock data insights and enhance product innovation, ultimately delivering excellent customer experiences and helping brands gain a competitive edge.

📋 Description

• Design and develop scalable automation frameworks for UI, API, and integration testing • Integrate automated tests into CI/CD pipelines and drive CI/CD quality gates • Design AI-specific test strategies and validate ML models across accuracy, precision, recall, bias, and drift • Test data pipelines and feature engineering processes; validate LLM responses for hallucination risk and output consistency • Perform test planning, review automation code, and ensure best practices across the test codebase • Monitor model quality in production and support release validation and quality assurance processes • Use AI-forward tools such as Claude, Cursor, and other modern AI assistants to ship quality work • Collaborate with developers, ML engineers, DevOps, and product teams across the full SDLC • Communicate quality status, testing findings, and risks to stakeholders • Participate in sprint ceremonies, design reviews, and release planning • Lead quality efforts with growing ownership of testing strategy and automation architecture • Contribute to QA standards and best practices and improve coverage, reliability, and automation • Mentor junior engineers and support their growth

🎯 Requirements

• 3–4+ years of experience in QA, data QA, or AI testing • Solid knowledge of both automation and AI testing • Strong programming skills in Python and at least one other language such as Java or JavaScript • Hands-on experience designing and maintaining automation frameworks • Strong understanding of the ML lifecycle and model evaluation metrics including accuracy, precision, recall, bias, and drift • Knowledge of AI testing methodologies including LLM validation, hallucination testing, and data pipeline validation • Experience with CI/CD pipelines, API automation, and version control • Familiarity with MLOps pipelines and model monitoring in production environments • Strong understanding of Agile methodologies • Experience with test management tools such as Jira and TestRail • Demonstrable usage of AI-forward tools such as Claude and Cursor • Experience with mobile automation, performance testing, LLM testing frameworks, prompt engineering, or cloud ML platforms is a plus