Software Engineer – Coding Evaluation, Training Data

πŸ•’ July 28

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟒 Junior

🟑 Mid-level

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸš«πŸ‘¨β€πŸŽ“ No degree required

Where this job comes from

Posted on Surge AI's careers page β†—Surge AI's careers page, not through a job board

First seen by Remote Rocketship July 28

Still open on Surge AI's site. Checked 6 hours ago.

Apply Now
Logo of Surge AI

Surge AI

51 - 200 employees

Founded 2020

πŸ€– Artificial Intelligence

πŸ”Œ API

☁️ SaaS

πŸ’° $25M Series A on 2020-07

Artificial Intelligence β€’ API β€’ SaaS

Surge AI is a company that provides high-quality training data and data-labeling solutions for machine learning teams. It offers an API-driven, SaaS platform that combines human-in-the-loop annotation, quality control, and tooling for collecting, validating, and managing datasets to accelerate model development and improve model performance.

πŸ“‹ Description

β€’ Own end-to-end coding data projects, from initial scoping and pilot design through execution, iteration, and scale-up. β€’ Design agentic training workflows and task structures that mirror real-world SWE work (e.g., refactoring, debugging, code review, large-repo navigation, tool use). β€’ Define and iterate on rubrics, golden sets, and reward signals that capture true engineering value, not just β€œdoes it compile.” β€’ Evaluate data and worker output with strong SWE taste, and make calls about what meets the bar for frontier training. β€’ Design and run qualification processes for coding workers, including hands-on assessments of their coding ability. β€’ Set up or partner on complex technical environments (e.g., containers, repos, test harnesses, sandboxes, code execution infrastructure). β€’ Partner with technical staff at our clients to translate high-level training goals into concrete projects and technical environments. β€’ Collaborate closely with Surge engineering, product, and operations to improve our coding data products, internal tools, and execution processes.

🎯 Requirements

β€’ 2–6+ years of professional software engineering experience building and maintaining real systems. β€’ Strong coding ability in at least one mainstream language and comfort working in production codebases. β€’ High β€œtaste” for good engineering: you care about correctness, code quality, and how real engineering teams actually work. β€’ Ability to reason about and debug technical environments, including containers, dependencies, and automated test setups. β€’ Interest in owning projects end-to-end, including scoping, workflow design, execution, and continuous improvement. β€’ Excellent written and verbal communication skills, with the ability to speak credibly with senior client engineers and translate fuzzy goals into actionable plans. β€’ Excitement about AI/ML systems and the role of data, evaluation, and reward design in improving agentic coding capabilities.

πŸ–οΈ Benefits

β€’ Competitive salary β€’ Remote work flexibility β€’ Professional development opportunities

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ July 28

The Voleon Group

201 - 500

πŸ’Έ Finance

πŸ€– Artificial Intelligence

Senior Software Engineer leading design and evolution of analytics infrastructure at Voleon. Collaborating with Data Scientists and Researchers to ensure analytics systems run reliably.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $200k - $255k / year

⏰ Full Time

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ July 28

Ocra

11 - 50

🏨 Hospitality

☁️ SaaS

πŸ€– Artificial Intelligence

Mid-level full-stack engineer focused on developing features for AI-powered revenue management SaaS. Collaborating in a small, distributed team environment.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $130k - $160k / year

πŸ’° $1.5M Venture Round - Ocra on 2023-03

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ July 28

TrueShort

2 - 10

πŸ“± Media

πŸ‘₯ B2C

Senior full-stack engineer developing web applications for AI-driven film studio and distribution platform. Influencing product development and maintaining CMS while collaborating with talented teams.

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ July 28

Ncontracts

201 - 500

☁️ SaaS

πŸ“‹ Compliance

🏦 Banking

Senior software developer building and integrating Ncontracts’ risk and compliance solutions for financial institutions. Developing scalable applications, mentoring engineers, and improving delivery practices.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $130k - $160k / year

πŸ’° Private Equity Round - Ncontracts on 2015-05

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ§‘β€πŸ’» Full-stack Engineer

πŸ•’ July 28

VillageSQL

2 - 10

πŸ€– Artificial Intelligence

🀝 B2B

🏒 Enterprise

Software Engineer developing core database features for VillageSQL Cloud. Shape the future of a community-driven project with a focus on performance, stability, and scalability.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $118k - $250k / year

⏰ Full Time

🟑 Mid-level

πŸ§‘β€πŸ’» Full-stack Engineer

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok