Senior Software Engineer – Open Source, SWE-Bench Evaluation

🔥 19 hours ago

🇦🇷 Argentina – Remote

💵 $65 / hour

⏳ Contract/Temporary

🟠 Senior

🧑‍💻 Full-stack Engineer

👻 Ghost score 0%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Anyone AI

Anyone AI

11 - 50 employees

Founded 2022

📚 Education

🤖 Artificial Intelligence

🎯 Recruiter

💰 $1.5M Pre Seed Round - Anyone AI on 2022-06

Education • Artificial Intelligence • Recruitment

Anyone AI is a Latin America–focused career accelerator and training academy that develops software engineers into AI and machine learning professionals through intensive, remote, mentor-led programs. It combines technical coursework (e. g. , Machine Learning Developer track), professional preparation (resume/LinkedIn optimization, interview coaching, English practice), and a placement-oriented model (income-share payments and access to employer partnerships) to help graduates secure higher-paying AI roles globally. Anyone AI also operates a talent marketplace connecting its community to companies seeking AI talent.

📋 Description

• Review software engineering tasks derived from real GitHub issues and pull requests • Assess real-world bug fixes and feature implementations • Evaluate open-source repositories, pull requests, unit tests, and test coverage • Review repository setup and dependency management • Assess reproducibility and environment configuration • Evaluate task difficulty, complexity, and multi-file or cross-module code changes • Determine whether tasks are clearly specified, technically solvable, appropriately tested, and representative of professional software engineering problems • Identify flaky tests, missing dependencies, ambiguous requirements, version conflicts, and environment-specific behavior • Provide clear recommendations on whether tasks should be accepted, improved, or excluded • Provide technical feedback and quality assessments

🎯 Requirements

• 3+ years of professional software engineering experience • Strong experience working with large, multi-file codebases • Experience reviewing pull requests, debugging issues, and maintaining production code • Strong understanding of unit testing and test coverage • Ability to evaluate whether tests correctly validate a solution without unnecessarily restricting implementation approaches • Experience with dependency management, environment setup, and reproducibility • Strong understanding of Git and GitHub-based development workflows • Ability to analyze complex technical problems and provide clear written feedback • Contributions to or maintenance of open-source projects (nice to have) • Experience with SWE-Bench, SWE-Bench Verified, or similar coding benchmarks (nice to have) • Experience with major Python open-source projects such as Django, Flask, scikit-learn, SymPy, matplotlib, requests, or pytest (nice to have) • Experience with Docker, CI/CD, pip, conda, or dependency pinning (nice to have) • Knowledge of test fixtures, test isolation, or property-based testing (nice to have) • Experience designing technical assessments or reviewing coding challenges (nice to have) • Experience with AI/ML evaluation, data curation, RLHF, or benchmark development (nice to have)

🏖️ Benefits

• $65 per hour compensation • Remote work • Part-time, project-based consulting engagement

Apply Now

Similar Jobs

🕒 August 13

Coderio

201 - 500

💼 Consulting

📦 Logistics

📣 Marketing

Senior Java Engineer designing and operating backend microservices for Coderio, a provider of scalable digital solutions. Applying AWS, Kafka, NoSQL, resilience patterns, and AI in complex fintech systems.

🗣️🇪🇸 Spanish Required

AWS

Java

Kafka

NoSQL

Go

🕒 July 30

AstroPay

201 - 500

💳 Fintech

👥 B2C

🤝 B2B

Product Lead / Senior Software Engineer at AstroPay, building the next generation of global financial infrastructure. Designing backend systems and scalable architectures within payments and fintech domains.

AWS

Cloud

Distributed Systems

Java

🕒 July 29

Ready

11 - 50

🎯 Recruiter

👥 HR Tech

🏪 Marketplace

Líder Técnico WSO2 para implementar plataformas de integración y middleware en proyectos tecnológicos de LATAM. Diseñando arquitecturas SOA, APIs y microservicios, y coordinando equipos técnicos e infraestructura.

🗣️🇪🇸 Spanish Required

Docker

Kubernetes

SOAP

🕒 July 23

Ryz Labs

11 - 50

💼 Consulting

📦 Logistics

📣 Marketing

Technical Lead guiding engineering for eDiscovery tools in LATAM, focusing on scalable product development. Leading a team to establish technical foundations and innovate in legal tech.

Cloud

🕒 June 29

Coderio

201 - 500

💼 Consulting

📦 Logistics

📣 Marketing

JavaScript

Kubernetes

Node.js

Python

React

SQL