Head of Evaluations – Legal AI Benchmarking

🔥 1 minute ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Newcode.ai

Newcode.ai

11 - 50 employees

Founded 2021

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Newcode. ai is an AI platform that enables law firms, Fortune 500 companies, and in-house legal teams to build secure, explainable, and compliant agentic workflows. Its Agentic AI Builder lets professional teams create and test custom workflows to automate complex legal tasks like document review and drafting, with sandbox testing, integration with document management systems, and deployment on-cloud or on-prem. The company emphasizes security, compliance, and enterprise-grade controls for scaling AI across legal and regulated environments.

📋 Description

• Design Legal Benchmarks for: Contract Drafting, Information Extraction, Legal Research, and Contract Review • Build, source and maintain relevant datasets • Audit AI Output: Review and score complex AI-generated legal text, contract analyses, and statutory interpretations for accuracy and precision and lay out a strategy. • Define Evaluation Metrics: Establish clear criteria for grading model performance, specifically focusing on logical reasoning, citation accuracy, and the model's ability to safely abstain from answering. • Collaborate with Engineering: Partner directly with Engineering to translate legal errors into actionable technical feedback for model fine-tuning.

🎯 Requirements

• PhD or Masters in statistics, mathematics, machine learning or equivalent • Analytical Skills: Proven ability to break down complex statutory frameworks and case law into structured, logical data points. • Tech-Savviness: python, panda, numpy, jupiter notebooks and similar statistical models

Apply Now

Similar Jobs

🔥 10 minutes ago

CareSource

1001 - 5000

⚕️ Healthcare Insurance

Assistant General Counsel providing legal counsel on regulatory, compliance, and corporate matters within CareSource. Collaborating with General Counsel and legal team to manage complex legal issues.

🔥 2 hours ago

Illumina

5001 - 10000

🧬 Biotechnology

⚕️ Healthcare Insurance

🔬 Science

Chief Legal Officer managing legal operations and governance for Illumina, enhancing global healthcare access. Responsible for legal leadership, regulatory compliance, and risk management.

🔥 6 hours ago

Stripe

1001 - 5000

💳 Fintech

🛍️ eCommerce

🤝 B2B

Product Counsel advising on cryptocurrency and stablecoin product compliance and commercialization at Stripe. Collaborating across product, engineering, and compliance teams to ensure legal adherence.

🕒 Yesterday

Capital Insurance Group

201 - 500

💸 Finance

👥 B2C

Claims Counsel handling complex insurance claims and consulting with claims staff for California Capital Insurance. Ensuring compliance and providing legal support for claims issues across multiple jurisdictions.

🕒 Yesterday

Capital Insurance Group

201 - 500

💸 Finance

👥 B2C

Claims Counsel providing strategic support for claims exceeding authority levels at CIG. Analyzing complex claims, maintaining consistency, and working with outside counsel as needed.