Head of Evaluations – Legal AI Benchmarking

Likely ghost job

πŸ•’ July 15

Where this job comes from

Posted on Newcode.ai's careers page β†—Newcode.ai's careers page, not through a job board

First seen by Remote Rocketship July 15

Still open on Newcode.ai's site. Checked Yesterday.

Apply Now
Logo of Newcode.ai

Newcode.ai

11 - 50 employees

Founded 2021

πŸ’Ό Consulting

βš–οΈ Legal

πŸ€– Artificial Intelligence

Consulting β€’ Legal β€’ Artificial Intelligence

Newcode. ai is an AI platform that enables law firms, Fortune 500 companies, and in-house legal teams to build secure, explainable, and compliant agentic workflows. Its Agentic AI Builder lets professional teams create and test custom workflows to automate complex legal tasks like document review and drafting, with sandbox testing, integration with document management systems, and deployment on-cloud or on-prem. The company emphasizes security, compliance, and enterprise-grade controls for scaling AI across legal and regulated environments.

πŸ“‹ Description

β€’ Design Legal Benchmarks for: Contract Drafting, Information Extraction, Legal Research, and Contract Review β€’ Build, source and maintain relevant datasets β€’ Audit AI Output: Review and score complex AI-generated legal text, contract analyses, and statutory interpretations for accuracy and precision and lay out a strategy. β€’ Define Evaluation Metrics: Establish clear criteria for grading model performance, specifically focusing on logical reasoning, citation accuracy, and the model's ability to safely abstain from answering. β€’ Collaborate with Engineering: Partner directly with Engineering to translate legal errors into actionable technical feedback for model fine-tuning.

🎯 Requirements

β€’ PhD or Masters in statistics, mathematics, machine learning or equivalent β€’ Analytical Skills: Proven ability to break down complex statutory frameworks and case law into structured, logical data points. β€’ Tech-Savviness: python, panda, numpy, jupiter notebooks and similar statistical models

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ July 14

Political Asylum Lawyers

11 - 50

βš–οΈ Legal

πŸ‘₯ B2C

🌍 Social Impact

Drafting Attorney focused on legal research and document preparation for asylum cases. Working with a team at Political Asylum Lawyers to create impactful legal documents.

πŸ•’ July 13

OnDek Solutions

1 - 10

πŸ’Ό Consulting

πŸŽ–οΈ Defense

πŸ“¦ Logistics

Workers Compensation Defense Attorney working with clients on workers' compensation cases. Leading dispute resolution and legal advocacy in a collaborative environment.

πŸ•’ July 10

Codes Health

11 - 50

πŸ₯ Healthcare

βš–οΈ Legal

πŸ€– Artificial Intelligence

Medical Records Retrieval Lead managing legal record retrieval for healthcare providers. Automating processes and ensuring compliance with high accuracy for law firms.

πŸ•’ July 8

The Hartford

10,000+ employees

πŸ›‘οΈ Insurance

πŸ’Έ Finance

πŸ‘₯ B2C

Senior Staff Attorney litigating insurance defense cases focusing on the California region and providing legal strategies. Requires expertise in Northern California legal matters with extensive trial experience.

πŸ•’ July 8

Abramson Labor Group

51 - 200

βš–οΈ Legal

🀝 B2B

Abramson Labor Group seeks a California State Barred Associate Attorney for Workers' Compensation. Join a leading law firm dedicated to employees' rights with a supportive team environment.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok