Software Engineering Evaluator, Contract

Job not on LinkedIn

🔥 0 minutes ago

🌐 United States, Canada, +1 more countries – Remote

🇺🇸 United States – Remote 🇨🇦 Canada – Remote 🇬🇧 United Kingdom – Remote

🏄 California – Remote

🏄 California – Remote

💵 $50 - $125 / hour

⏳ Contract/Temporary

🟢 Junior

🟡 Mid-level

🧑‍💻 Full-stack Engineer

🚫👨‍🎓 No degree required

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Recruit Recruit Ltd

WebsiteLinkedInAll Job Openings

1 - 10 employees

Founded 2009

💼 Consulting

📣 Marketing

🎯 Recruiter

Consulting • Marketing • Recruitment

Recruit Recruit Ltd is a UK-based recruitment and HR consultancy specializing in providing subscription-based recruitment, retained headhunting and executive search, permanent and interim recruitment, HR consultancy and services, and training and development to SMEs, startups, and corporations across the UK and Ireland. The firm focuses on matching culture-fit talent to businesses scaling rapidly or refining their teams, and also offers case studies, vacancies, resources, and bespoke coaching to support client growth. They emphasize a pragmatic, no-nonsense approach and work primarily on B2B client engagements.

📋 Description

• Design task-specific grading criteria for feature implementations, bug fixes, refactors, tests, and code reviews • Evaluate AI-generated code for correctness, including failures that pass the code's own tests • Assess edge-case handling, security, performance, and readability in coding deliverables • Write clear, evidence-based justifications for every evaluation score • Apply consistent judgment across software engineering evaluation tasks • Review code that may appear correct and run without failing while identifying subtle defects • Reason through ambiguity and distinguish clearly between known facts and inferences during evaluations • Iterate on evaluation work based on feedback from senior reviewers

🎯 Requirements

• 2–3 years of professional software engineering experience shipping production code • Strong command of at least one of Python, JavaScript/TypeScript, Java, Go, C++, C#, or a comparable language • Solid grounding in data structures, algorithms, testing, debugging, and version control • Experience reviewing other engineers' code • Excellent written English • Ability to follow complex instructions, reason through ambiguity, and spot subtle errors in code that looks correct and runs without failing • Ability to clearly separate what you know from what you are inferring • Ability to work independently, learn new tools quickly, and take feedback well • Based in and working from the US, Canada, or UK • Available for 10+ hours per week for the full 12 weeks

🏖️ Benefits

• Paid weekly via Stripe or Wise • Remote work on your own schedule within the 10+ hour weekly engagement • Initial 12-week contract with the possibility that projects may be extended based on needs and performance • Opportunity to evaluate AI systems for leading AI research organizations • Reasonable accommodations available upon request