Applied Computer Science Benchmark Specialist

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Weekday (YC W21)

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2021

💼 Consulting

👥 HR Tech

☁️ SaaS

Consulting • HR Tech • SaaS

Weekday is a modern recruitment platform that combines AI technologies with a vast database of potential candidates, aiming to streamline the hiring process for companies in India. They offer various services, including a proactive outreach approach that helps employers connect with top talent, as well as tools for candidates to easily apply for jobs. Weekday's emphasis on candidate engagement through multiple channels, including email, WhatsApp, and phone calls, sets it apart in the competitive landscape of recruitment agencies.

📋 Description

• Author original, challenging multiple-choice questions across computer science domains • Assess question difficulty and submit authored questions for review • Review existing questions for technical accuracy, clarity, completeness, precision, rigor, and solvability • Edit questions as necessary and document the rationale for recommended changes • Provide one correct answer and nine plausible but subtly incorrect alternatives • Develop structured solution explanations demonstrating the reasoning and technical principles behind correct answers • Provide 1–5 authoritative references per question • Apply consistent standards to evaluate questions and solutions and ensure benchmark quality and reproducibility • Contribute to gold-standard benchmarks for evaluating advanced AI systems

🎯 Requirements

• Expertise in one or more listed domains: Accelerator/GPU Kernel Engineering, Formal Methods & Automated Reasoning, Computer Architecture & Accelerators, Distributed Systems, DevOps & Site Reliability Engineering, Data Engineering & Databases, Cloud Computing & Infrastructure, Operating Systems & Systems Kernel, Machine Learning Engineering, Web & API Development, Embedded Systems Engineering, Computer Graphics & Game Development, or Mobile Engineering • PhD or doctoral candidacy in Computer Science, Electrical Engineering, Computer Engineering, or a closely related discipline • A Master's degree may be considered for candidates with exceptional expertise in a specialized computer science domain • Strong command of graduate-level computer science theory, algorithms, systems, software engineering, architecture, and/or machine learning • Demonstrated depth in one or more listed technical domains • Excellent written English and ability to communicate complex technical concepts clearly, accurately, and concisely • Strong attention to detail and ability to distinguish technically valid solutions from plausible but incorrect approaches • Expected commitment of 10+ hours per week • Must be eligible to work as an independent contractor; H-1B and STEM OPT candidates are not eligible • Selected candidates may be asked to complete a short technical assessment or provide additional information about their expertise

🏖️ Benefits

• Flexible scheduling based on project requirements • Fully remote and asynchronous work • Opportunity to contribute to high-quality benchmarks for evaluating advanced AI systems • Strong contributors may be considered for additional review, evaluation, or subject-matter expert opportunities • Work can be completed on your own schedule • Weekly payments through Stripe or Wise, based on services rendered • Reasonable accommodations throughout the application and engagement process