Staff Software Engineer, AI Evals

Job not on LinkedIn

πŸ•’ October 20

Where this job comes from

Posted on G2i Inc.'s careers page β†—G2i Inc.'s careers page, not through a job board

First seen by Remote Rocketship October 20

Still open on G2i Inc.'s site. Checked 5 hours ago.

Apply Now
Logo of G2i Inc.

G2i Inc.

11 - 50 employees

🎯 Recruiter

🏒 Enterprise

☁️ SaaS

Recruitment β€’ Enterprise β€’ SaaS

G2i Inc. is a video-based platform specializing in the hiring of contract or full-time engineers. With a vast pool of over 8,000 engineers, G2i offers quality matches quickly by customizing its sourcing process based on client needs. They provide a 7-day free trial to engage potential hires before making a commitment. The platform emphasizes speed and quality, utilizing video assessments and AI training to ensure engineers meet specific technical standards. G2i handles compliance, international payments, and background checks, providing a streamlined hiring process for companies looking to hire in the US, Canada, Latin America, or Europe. By focusing on technical roles such as JavaScript, Python, iOS, Android, and AI engineers, G2i ensures companies can hire top talent efficiently.

πŸ“‹ Description

β€’ Evaluate AI-generated coding interactions end-to-end β€’ Assess whether responses make sense and whether preambles and reasoning are useful β€’ Judge whether outputs reflect strong engineering judgment and align with how an experienced engineer would think β€’ Evaluate the quality of explanations and reasoning, not just code β€’ Distinguish between different levels of response quality β€’ Provide clear, opinionated feedback on what worked, what did not, and what felt misleading β€’ Help define what great interactions look like for tools such as Cursor β€’ Evaluate interactions with modern coding agents including OpenAI Codex and Claude Code

🎯 Requirements

β€’ Staff / Principal-level engineer (or equivalent experience) β€’ Strong background in Go, Python, Rust, or TypeScript / JavaScript β€’ Hands-on experience using OpenAI Codex, Claude Code, and Cursor β€’ Deep familiarity with modern AI-assisted development workflows β€’ Ability to evaluate code without needing to fully execute or deeply review every line β€’ Comfortable giving direct, opinionated feedback β€’ High bar for what β€œgood engineering” looks like β€’ Able to make subjective but rigorous judgments β€’ Experience with Cursor or similar AI-first IDEs (nice to have) β€’ Prior exposure to prompt design or evaluation workflows (nice to have) β€’ Experience mentoring senior engineers or defining engineering standards (nice to have) β€’ Native English speaker or fluent English at C2+ level β€’ Agreement to complete a simple background check β€’ Must complete a take-home evaluation exercise

πŸ–οΈ Benefits

β€’ $100–$200/hour compensation β€’ Flexible workload of approximately 20–40 hours per week β€’ Contract duration through October with possible extensions β€’ Start ASAP

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 20

NeoReach

51 - 200

πŸ“£ Marketing

πŸ”Œ API

Senior Data & AI Engineer building data integrations and AI-powered workflows for NeoReach, a creator-technology and influencer-marketing company. Delivering reliable tools that improve operations and decision-making.

πŸ•’ July 29

Statheros

2 - 10

AI Engineer developing and optimizing PPO algorithms for air traffic radar systems in a defense tech firm. Collaborating with teams to innovate and implement intelligent systems for complex problem-solving.

πŸ•’ July 13

Rwazi

11 - 50

πŸ€– Artificial Intelligence

☁️ SaaS

🀝 B2B

AI Engineer at Rwazi automating marketing workflows into AI systems. Building tools for efficient lead sourcing, engagement, and reporting.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ”₯ Funding within the last year

πŸ’° $12M Series A - Rwazi on 2025-07

⏳ Contract/Temporary

🟠 Senior

πŸ€– AI Engineer

πŸ•’ June 24

Black Pearl Consult

11 - 50

πŸ’Ό Consulting

🎯 Recruiter

AI Engineer designing and optimizing AI solutions for enterprise automation and analytics. Collaborating with consulting teams on machine learning implementations for intelligent decision-making.

πŸ•’ June 24

Black Pearl Consult

11 - 50

πŸ’Ό Consulting

🎯 Recruiter

Lead AI-driven transformation projects and infrastructure optimization at a technology firm. Oversee machine learning integration and cross-functional teams with a focus on automation and optimization.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok