Senior Python Developer, AI Evaluation & Benchmarking

Job not on LinkedIn

🔥 31 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Lifted

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2018

🏥 Healthcare

👥 HR Tech

📋 Compliance

💰 $6.2M Series A - Lifted on 2021-06

Healthcare • HR Tech • Compliance

Lifted is a platform for health and social care providers that streamlines recruiting, onboarding, sponsorship and ongoing compliance. The product offers access to pre-screened care workers, automated background and right-to-work checks, digital training and audit-ready records, Certificate of Sponsorship and visa application support, and real-time compliance dashboards and alerts. It is built to help care employers hire, sponsor and stay audit-ready with embedded immigration and compliance workflows.

📋 Description

• Design and develop coding benchmarks used to evaluate frontier AI models • Analyze AI-generated code for correctness, reliability, efficiency, and edge cases • Build and maintain scalable data pipelines that support AI evaluation workflows • Create structured programming scenarios to test reasoning, debugging, and code quality • Work with large codebases and multi-language software environments • Collaborate with teams focused on improving how AI models understand, generate, and evaluate software • Write clean, maintainable, and well-tested Python code following software engineering best practices

🎯 Requirements

• 4+ years of professional software engineering experience (required) • Expert-level proficiency in Python • Experience working at a high-growth technology company or top-tier software organization • Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar • Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit • Strong understanding of software engineering best practices, debugging, and code quality • Excellent analytical and problem-solving skills • Experience with AI/ML evaluation, model benchmarking, or Generative AI (nice to haves) • Background in security engineering (nice to haves) • Significant contributions to open-source software projects (nice to haves) • Experience working with large-scale distributed systems or enterprise software platforms (nice to haves)

🏖️ Benefits

• Fully remote contract opportunity • Weekly payments for approved work completed during the previous week