AI Evaluator – Staff Software Engineer

Job not on LinkedIn

🔥 5 minutes ago

🇺🇸 United States – Remote

⏳ Contract/Temporary

🔴 Lead

🧑‍💻 Full-stack Engineer

👻 Ghost score 21%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

G2i Inc.

WebsiteLinkedInAll Job Openings

11 - 50 employees

🎯 Recruiter

🏢 Enterprise

☁️ SaaS

Recruitment • Enterprise • SaaS

G2i Inc. is a video-based platform specializing in the hiring of contract or full-time engineers. With a vast pool of over 8,000 engineers, G2i offers quality matches quickly by customizing its sourcing process based on client needs. They provide a 7-day free trial to engage potential hires before making a commitment. The platform emphasizes speed and quality, utilizing video assessments and AI training to ensure engineers meet specific technical standards. G2i handles compliance, international payments, and background checks, providing a streamlined hiring process for companies looking to hire in the US, Canada, Latin America, or Europe. By focusing on technical roles such as JavaScript, Python, iOS, Android, and AI engineers, G2i ensures companies can hire top talent efficiently.

📋 Description

• Evaluate AI-generated coding interactions end-to-end • Assess whether responses, preambles, reasoning, and outputs reflect strong engineering judgment • Evaluate the quality and usefulness of explanations and reasoning, not only code correctness • Distinguish between different levels of response quality • Provide clear, opinionated feedback on what worked, what failed, and what felt misleading • Help define what great interactions look like for tools such as Cursor • Make subjective but rigorous judgments about AI coding-agent behavior

🎯 Requirements

• Staff / Principal-level engineer or equivalent experience • Strong background in Go, Python, Rust, or TypeScript / JavaScript • Hands-on experience using OpenAI Codex, Claude Code, and Cursor • Deep familiarity with modern AI-assisted development workflows • Ability to evaluate code without fully executing or deeply reviewing every line • Comfortable giving direct, opinionated feedback • High standards for engineering quality • English proficiency at C1 or higher, or native/first-language English • Resume, LinkedIn profile, and successful take-home evaluation exercise • Background check

🏖️ Benefits

• Short-term contract engagement • Flexible commitment of approximately 20–40 hours per week • Engagement duration ranging from 2 weeks to 6 months

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume