Senior Python Engineer – LLM Code Evaluation

Job not on LinkedIn

🔥 14 hours ago

🇺🇸 United States – Remote

💵 $100 - $200 / hour

⏳ Contract/Temporary

🟠 Senior

🔙 Backend Engineer

👻 Ghost score 7%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

G2i Inc.

WebsiteLinkedInAll Job Openings

11 - 50 employees

🎯 Recruiter

🏢 Enterprise

☁️ SaaS

Recruitment • Enterprise • SaaS

G2i Inc. is a video-based platform specializing in the hiring of contract or full-time engineers. With a vast pool of over 8,000 engineers, G2i offers quality matches quickly by customizing its sourcing process based on client needs. They provide a 7-day free trial to engage potential hires before making a commitment. The platform emphasizes speed and quality, utilizing video assessments and AI training to ensure engineers meet specific technical standards. G2i handles compliance, international payments, and background checks, providing a streamlined hiring process for companies looking to hire in the US, Canada, Latin America, or Europe. By focusing on technical roles such as JavaScript, Python, iOS, Android, and AI engineers, G2i ensures companies can hire top talent efficiently.

📋 Description

• Evaluate AI-generated coding interactions end-to-end • Judge whether responses are useful, correct at a high level, and aligned with strong engineering judgment • Assess the quality of explanations, preambles, and reasoning • Distinguish between different levels of response quality • Provide clear, opinionated feedback on what worked, what failed, and what felt misleading • Help define what excellent interactions look like for tools such as Cursor • Determine whether AI coding agents communicate and guide users like strong engineers • Evaluate interactions with OpenAI Codex and Claude Code rather than writing production code

🎯 Requirements

• Highly experienced software engineer at Senior+ level • Staff / Principal-level engineer or equivalent experience • Strong background in TypeScript / JavaScript or Python • Hands-on experience using OpenAI Codex, Claude Code, and Cursor • Deep familiarity with modern AI-assisted development workflows • Able to evaluate code without fully executing or deeply reviewing every line • Comfortable providing direct, opinionated feedback • High standards for good engineering • Take-home evaluation exercise • One behavioral interview • Agreement to a simple background check • Availability to start ASAP and work through early May • Preferred languages selected from the listed programming languages, including Python and TypeScript • Location information required as part of the application

🏖️ Benefits

• $100–$200/hour compensation • Possible contract extension • Flexible part-time engagement of approximately 10–20 hours per week