Head of Evaluations – Legal AI Benchmarking

🕒 July 15

🌐 United States, United Kingdom, +2 more countries – Remote

🇺🇸 United States – Remote 🇬🇧 United Kingdom – Remote 🇳🇴 Norway – Remote 🇸🇪 Sweden – Remote

🗽 New York – Remote

🗽 New York – Remote

⏰ Full Time

🔴 Lead

🧑‍💼 Attorney / Lawyer

👻 Ghost score 42%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Newcode.ai

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2021

💼 Consulting

⚖️ Legal

🤖 Artificial Intelligence

Consulting • Legal • Artificial Intelligence

Newcode. ai is an AI platform that enables law firms, Fortune 500 companies, and in-house legal teams to build secure, explainable, and compliant agentic workflows. Its Agentic AI Builder lets professional teams create and test custom workflows to automate complex legal tasks like document review and drafting, with sandbox testing, integration with document management systems, and deployment on-cloud or on-prem. The company emphasizes security, compliance, and enterprise-grade controls for scaling AI across legal and regulated environments.

📋 Description

• Design Legal Benchmarks for: Contract Drafting, Information Extraction, Legal Research, and Contract Review • Build, source and maintain relevant datasets • Audit AI Output: Review and score complex AI-generated legal text, contract analyses, and statutory interpretations for accuracy and precision and lay out a strategy. • Define Evaluation Metrics: Establish clear criteria for grading model performance, specifically focusing on logical reasoning, citation accuracy, and the model's ability to safely abstain from answering. • Collaborate with Engineering: Partner directly with Engineering to translate legal errors into actionable technical feedback for model fine-tuning.

🎯 Requirements

• PhD or Masters in statistics, mathematics, machine learning or equivalent • Analytical Skills: Proven ability to break down complex statutory frameworks and case law into structured, logical data points. • Tech-Savviness: python, panda, numpy, jupiter notebooks and similar statistical models