Research Engineer / Scientist, Data & Evals

πŸ•’ October 30

Where this job comes from

Posted on Harvey's careers page β†—Harvey's careers page, not through a job board

First seen by Remote Rocketship October 30

Still open on Harvey's site. Checked 1 hour ago.

Apply Now
Logo of Harvey

Harvey

11 - 50 employees

πŸ€– Artificial Intelligence

βš–οΈ Legal

🏒 Enterprise

πŸ’° $80.6G Series B on 2023-12

Artificial Intelligence β€’ Legal β€’ Enterprise

Harvey is a professional class AI solution tailored specifically for law firms, professional service providers, and Fortune 500 companies. It offers a suite of domain-specific tools that enable users to delegate complex tasks in natural language to a customized personal assistant. Harvey's platform facilitates rapid research with grounded results across legal, regulatory, and tax domains, while also providing secure project workspaces for document analysis through generative AI. With a focus on enterprise-grade security and industry-leading AI models, Harvey aims to streamline workflows and free professionals, such as lawyers, from mundane tasks, enabling them to concentrate on strategic and advisory roles.

πŸ“‹ Description

β€’ Build synthetic data pipelines generating, filtering, and curating training and evaluation samples for complex legal reasoning and agentic workflows β€’ Design evaluations and verifiers reflecting real legal work, calibrate them against expert judgment, and investigate failures β€’ Build and maintain capability benchmarks such as the Legal Agent Benchmark (LAB) β€’ Build product-focused evaluations tracking model performance on real customer workflows β€’ Work with legal domain experts to define quality metrics, rubrics, and grading mechanisms β€’ Own training and evaluation data quality, including provenance, coverage, and contamination safeguards β€’ Connect product usage and customer feedback to new evaluations and training data β€’ Partner with researchers to investigate model failures, distinguish real gains from misleading metrics, and guide training and release decisions

🎯 Requirements

β€’ Experience building data pipelines, ML evaluation systems, or experimentation tooling β€’ Strong Python skills β€’ Ownership of production-quality code β€’ Rigorous measurement approach, including statistical reasoning and experimental design β€’ Understanding of when metrics can mislead β€’ Ability to translate ambiguous goals or expert judgment into structured datasets, rubrics, and measurable criteria β€’ Experience with synthetic data, LLM evaluations, automated raters, or preference data is a plus β€’ Strong data and measurement engineering experience close to ML model development is valuable β€’ Role available across multiple levels

πŸ–οΈ Benefits

β€’ Equity plan β€’ Comprehensive health coverage β€’ Dental coverage β€’ Vision coverage β€’ Retirement benefits with 401(k) match up to 4% β€’ Flexible PTO β€’ Benefits program

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 30

GitLab

1001 - 5000

πŸ’Ό Consulting

πŸ“£ Marketing

πŸ€– Artificial Intelligence

Data Scientist supporting GitLab’s DevSecOps platform with GTM analytics, machine learning, and experimentation. Building trusted metrics and models for Sales, Revenue Operations, and Finance.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $86.4k - $176.4k / year

πŸ’° Secondary Market on 2020-11

⏰ Full Time

🟑 Mid-level

πŸ“Š Data Scientist

πŸ•’ October 30

Nordic Naturals

201 - 500

πŸ₯ Healthcare

🍽️ Food & Beverage

🏭 Manufacturing

Master Data Manager governing customer, vendor, material, pricing, and finance data at Nordic Naturals, a nutritional supplement company. Driving SAP governance, data quality, controls, and process improvement.

πŸ•’ October 30

Skylight

51 - 200

πŸ’Ό Consulting

πŸ›οΈ Government

Data Scientist modernizing HHS data and AI inventories for Skylight’s government consultancy. Building analytical workflows, governance tools, and reporting for federal stakeholders.

πŸ•’ October 30

Skylight

51 - 200

πŸ’Ό Consulting

πŸ›οΈ Government

Data Scientist building analytics, AI tools, and data pipelines for Skylight, a digital consultancy improving government public services. Supporting ACF with grant and program data insights.

πŸ•’ October 30

Fetch Rewards

501 - 1000

πŸ’Ό Consulting

🍽️ Food & Beverage

πŸ“¦ Logistics

Senior Data Scientist improving Fetch’s rewards app retention and engagement through experiments. Building predictive lifecycle interventions that drive user and revenue outcomes.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $159.9k - $188.2k / year

πŸ’° Debt Financing on 2022-04

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ“Š Data Scientist

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok