Research Engineer / Scientist, Data & Evals

🔥 13 hours ago

🇺🇸 United States – Remote

💵 $230k - $450k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

📊 Data Scientist

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 21%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Harvey

WebsiteLinkedInAll Job Openings

11 - 50 employees

🤖 Artificial Intelligence

⚖️ Legal

🏢 Enterprise

💰 $80.6G Series B on 2023-12

Artificial Intelligence • Legal • Enterprise

Harvey is a professional class AI solution tailored specifically for law firms, professional service providers, and Fortune 500 companies. It offers a suite of domain-specific tools that enable users to delegate complex tasks in natural language to a customized personal assistant. Harvey's platform facilitates rapid research with grounded results across legal, regulatory, and tax domains, while also providing secure project workspaces for document analysis through generative AI. With a focus on enterprise-grade security and industry-leading AI models, Harvey aims to streamline workflows and free professionals, such as lawyers, from mundane tasks, enabling them to concentrate on strategic and advisory roles.

📋 Description

• Build synthetic data pipelines generating, filtering, and curating training and evaluation samples for complex legal reasoning and agentic workflows • Design evaluations and verifiers reflecting real legal work, calibrate them against expert judgment, and investigate failures • Build and maintain capability benchmarks such as the Legal Agent Benchmark (LAB) • Build product-focused evaluations tracking model performance on real customer workflows • Work with legal domain experts to define quality metrics, rubrics, and grading mechanisms • Own training and evaluation data quality, including provenance, coverage, and contamination safeguards • Connect product usage and customer feedback to new evaluations and training data • Partner with researchers to investigate model failures, distinguish real gains from misleading metrics, and guide training and release decisions

🎯 Requirements

• Experience building data pipelines, ML evaluation systems, or experimentation tooling • Strong Python skills • Ownership of production-quality code • Rigorous measurement approach, including statistical reasoning and experimental design • Understanding of when metrics can mislead • Ability to translate ambiguous goals or expert judgment into structured datasets, rubrics, and measurable criteria • Experience with synthetic data, LLM evaluations, automated raters, or preference data is a plus • Strong data and measurement engineering experience close to ML model development is valuable • Role available across multiple levels

🏖️ Benefits

• Equity plan • Comprehensive health coverage • Dental coverage • Vision coverage • Retirement benefits with 401(k) match up to 4% • Flexible PTO • Benefits program

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume