Senior Software Engineer, AI Evaluation Infrastructure

🕒 October 19

Where this job comes from

Posted on Turing's careers page ↗Turing's careers page, not through a job board

First seen by Remote Rocketship October 19

Still open on Turing's site. Checked 1 hour ago.

Apply Now
Logo of Turing

Turing

1001 - 5000 employees

Founded 2018

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Turing is a leading company in the field of artificial intelligence, specializing in the advancement of AGI (Artificial General Intelligence) and the evaluation and training of large language models (LLMs). Turing offers a comprehensive range of AI solutions, including model performance assessments, multimodal capabilities integration, and custom engineering for enterprises looking to optimize their AI operations. The company bridges cutting-edge AI research with practical applications, empowering organizations to leverage advanced AI for various real-world challenges.

📋 Description

• Design and ship end-to-end features spanning the data model, API, background workers, and UI • Build and improve agent and model evaluation workflows in sandboxed environments • Score evaluation results and turn thousands of runs into trustworthy results • Improve benchmark task quality checks using verifiers, rubric-based grading, and LLM-as-a-judge grading • Integrate new models, agents, and benchmarks using generalizable designs • Improve system performance and reliability through efficient queries, safe migrations, and concurrency under load • Review pull requests against engineering guidelines and maintain codebase consistency • Deliver tested changes, migrations, edge-case handling, and production-ready systems • Collaborate on frontier AI research and enterprise AI applications

🎯 Requirements

• 5+ years building and operating production backend systems • Ownership of at least one service from design through on-call • Bachelor’s degree or higher in Software Engineering, Computer Science, or a related field • Strong Python • Experience with Django or a similar framework • Experience with PostgreSQL • Experience with a task queue such as Celery • Hands-on experience in LLM evaluation beyond calling a model API • Understanding of benchmark task construction, agent trial scoring, and result aggregation and comparison • Judgment to identify ambiguous instructions, weak or gameable verifiers, leaked answers, and checks that pass for the wrong reason • Comfort with TypeScript and React frontend work • Clear technical writing • Nice to have: experience with Harbor, Terminal-Bench, SWE-bench, Inspect, or a similar harness • Nice to have: experience running agents in Docker, Kubernetes, Modal, or Daytona • Nice to have: experience with LLM-as-a-judge, rubric-based grading, distributed job scheduling, concurrency limits, database locking at scale, or open-source evaluation/infrastructure projects

🏖️ Benefits

• Equity • Work at the frontier of AI • Contribute to leading-edge AI research and showcase your work at top conferences such as ICLR, ICML, and NeurIPS • Bring frontier AI innovation to the enterprise • Collaborate with and learn from exceptional colleagues with deep AI experience • Startup-speed environment with ownership and impact

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 19

Reddit, Inc.

501 - 1000

💼 Consulting

📣 Marketing

📱 Media

Senior Forward Deployed Engineer building AI applications, agents, and automations for Reddit’s Sales, Marketing, Business Development, and Finance teams. Driving production adoption and measurable improvements in quality, speed, capacity, and cost.

🕒 October 19

Reddit, Inc.

501 - 1000

💼 Consulting

📣 Marketing

📱 Media

Lead AI engineer shaping Reddit’s applied AI strategy and building production agents, workflows, and automations. Improving business operations across Sales, Marketing, Business Development, and Finance.

🕒 October 19

Sedgwick

10,000+ employees

🏗️ Construction

💼 Consulting

🏥 Healthcare

Senior AI Engineer building and operating Generative AI systems for Sedgwick’s insurance and claims operations. Developing Python, React, AWS, Terraform, and human-in-the-loop solutions.

🕒 October 19

Sedgwick

10,000+ employees

🏗️ Construction

💼 Consulting

🏥 Healthcare

AI Platform Administrator governing Claude, ChatGPT Enterprise, and Microsoft 365 Copilot at Sedgwick, a global insurance-services company. Managing governance, Level 2 support, compliance, analytics, and adoption.

🕒 October 19

NeuraFlash

201 - 500

💼 Consulting

🏭 Manufacturing

📣 Marketing

Functional Lead delivering Salesforce, AWS, and Agentforce AI implementations for NeuraFlash, an Accenture company. Managing client delivery, project scope, financials, schedules, and customer relationships.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok