QA/Test Engineer

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Weekday (YC W21)

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2021

💼 Consulting

👥 HR Tech

☁️ SaaS

Consulting • HR Tech • SaaS

Weekday is a modern recruitment platform that combines AI technologies with a vast database of potential candidates, aiming to streamline the hiring process for companies in India. They offer various services, including a proactive outreach approach that helps employers connect with top talent, as well as tools for candidates to easily apply for jobs. Weekday's emphasis on candidate engagement through multiple channels, including email, WhatsApp, and phone calls, sets it apart in the competitive landscape of recruitment agencies.

📋 Description

• Develop comprehensive test scenarios for benchmark tasks, including edge cases, failure conditions, and unexpected inputs • Review task descriptions, requirements, expected outcomes, and reference solutions for ambiguity, inconsistencies, missing requirements, and quality issues • Use Python and development tools to investigate and resolve issues in task environments, validation logic, and automated checks • Create repeatable testing procedures, quality checklists, and review frameworks • Examine grading logic and AI-agent execution results for loopholes, shortcuts, inconsistent scoring, and benchmark reliability risks • Collaborate with researchers and task authors to communicate issues, recommend improvements, and validate fixes • Establish and enforce quality standards across technical evaluation datasets

🎯 Requirements

• MSc or PhD in a STEM discipline, or equivalent practical experience in a research-intensive or engineering-focused environment • 1+ years of experience in QA, test engineering, software engineering, research engineering, or a comparable quality-focused role • Ability to design effective test cases, develop QA processes, and investigate complex technical systems end-to-end • Working proficiency in Python and Git, including understanding unfamiliar codebases, environments, and technical workflows • Strong debugging and analytical skills • Exceptional attention to detail and clear, structured technical documentation practices • Ability to identify subtle failures, inconsistencies, edge cases, and unintended behaviors • Experience with AI evaluation, AI training, model testing, benchmark development, or reviewing AI-generated outputs is highly desirable • Comfortable working independently on ambiguous and open-ended technical problems • Strong written communication skills and ability to provide actionable feedback to technical stakeholders • Ability to commit reliably to approximately 35 hours per week