Research Engineer – Infrastructure

🕒 October 30

Where this job comes from

Posted on Harvey's careers page ↗Harvey's careers page, not through a job board

First seen by Remote Rocketship October 30

Still open on Harvey's site. Checked 1 hour ago.

Apply Now
Logo of Harvey

Harvey

11 - 50 employees

🤖 Artificial Intelligence

⚖️ Legal

🏢 Enterprise

💰 $80.6G Series B on 2023-12

Artificial Intelligence • Legal • Enterprise

Harvey is a professional class AI solution tailored specifically for law firms, professional service providers, and Fortune 500 companies. It offers a suite of domain-specific tools that enable users to delegate complex tasks in natural language to a customized personal assistant. Harvey's platform facilitates rapid research with grounded results across legal, regulatory, and tax domains, while also providing secure project workspaces for document analysis through generative AI. With a focus on enterprise-grade security and industry-leading AI models, Harvey aims to streamline workflows and free professionals, such as lawyers, from mundane tasks, enabling them to concentrate on strategic and advisory roles.

📋 Description

• Scale the post-training stack supporting SFT and RL on leading open-weight models • Build distributed rollout infrastructure coordinating model inference, tool execution, and training-experience collection for long-horizon tasks • Build reproducible agent environments for models to interact with documents, tools, and external systems during training and evaluation • Own performance and reliability of training runs, including GPU utilization, checkpointing, failure recovery, and observability • Identify and remove training and inference bottlenecks • Build internal tools and services for training-data management and versioning, evaluation, result browsing, and training-job and experiment tracking • Integrate models into production, including serving, latency, cost, and online evaluation • Partner with researchers to turn experimental workflows into dependable systems while enabling rapid experimentation

🎯 Requirements

• Experience building ML infrastructure, distributed systems, or research tooling, with ownership of performance, reliability, and operation • Strong Python and generalist software engineering skills across backend services, data systems, and internal tools • Familiarity with PyTorch, JAX, or similar ML frameworks • Experience with distributed training or inference, including diagnosing performance bottlenecks and failures across the stack • Understanding of post-training workflows • Practical judgment about what to build versus adopt • Ability to partner with researchers and ship quickly as needs evolve • Experience with RL rollouts, agent environments, or sandboxed tool execution is a plus • United States work authorization and visa sponsorship information required in application

🏖️ Benefits

• Equity plan • Comprehensive health, dental and vision coverage • Retirement benefits (401k match up to 4%) • Flexible PTO • Bonus eligibility • Opportunity for personal, professional, and financial growth

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 30

Liftoff Mobile

501 - 1000

📣 Marketing

Senior Infrastructure Engineer building distributed systems, cloud tooling, and real-time data infrastructure. Supporting Liftoff’s AI-powered performance marketing platform for the mobile app economy.

🕒 October 30

Boundless

1 - 10

💼 Consulting

🛍️ eCommerce

☁️ SaaS

Senior Infrastructure Engineer operating Boundless’s heterogeneous GPU fleet for AI inference. Optimizing orchestration, performance, reliability, and cost across cloud and on-premises infrastructure.

🕒 October 29

Conduent

10,000+ employees

🏥 Healthcare

📦 Logistics

💼 Consulting

Infrastructure Systems Engineer delivering resilient Windows and cloud infrastructure solutions for Conduent’s Fortune 100 and government clients. Leading automation, high availability, disaster recovery, and technical project delivery.

🕒 October 29

Tessera Labs

11 - 50

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

AI infrastructure engineer building Kubernetes, cloud, and LLM tooling for Tessera Labs’ enterprise multi-agent AI platform. Operating production agent infrastructure across customer environments.

🕒 October 29

Hex

51 - 200

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Infrastructure Engineer improving Kubernetes, AWS, CI/CD, databases, and security for Hex’s collaborative data analytics platform. Owning foundational projects across Hex’s multi-tenant and single-tenant environments.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok