Lead/Senior Inference Engineer

🔥 0 minutes ago

💵 $127.4k - $236.6k / year

⏰ Full Time

🟠 Senior

🔴 Lead

👷🏻‍♀️ Engineer

Where this job comes from

Posted on Thomson Reuters's careers page ↗Thomson Reuters's careers page, not through a job board

First seen by Remote Rocketship 0 minutes ago

Apply Now
Logo of Thomson Reuters

Thomson Reuters

10,000+ employees

Founded 2008

💼 Consulting

⚖️ Legal

🛡️ Insurance

Consulting • Legal • Insurance

Thomson Reuters is a global content and technology company that provides professionals with reliable and accurate solutions across the legal, tax and accounting, international trade, and risk management sectors. The company offers a range of products including legal research tools, tax preparation software, compliance and regulatory solutions, and media services like Reuters for global news. With significant investments in generative AI, Thomson Reuters continues to innovate in helping professionals optimize their workflows and enhance their decision-making. Their platforms serve various industries such as law firms, corporations, tax professionals, and media organizations, providing essential tools that combine powerful technology with in-depth expert content.

📋 Description

• Build and operate model-serving infrastructure for Thomson's production traffic • Implement and tune inference optimization techniques such as batching, caching, and quantization • Improve Mariner's observability as call volume and deployment surface grow • Implement ISO 27001 compliance controls and evidence • Implement cost tracking and attribution relied upon by Finance • Develop GPU-capacity contingency plans to prevent downtime or costly parallel running • Document cost, latency, and reliability tradeoffs and present them to the Director and partner teams • Work with training and evaluation pods to deploy new model releases to the serving stack • Establish team practices and tooling including on-call, incident reviews, and onboarding • Collaborate with research, product stakeholders, and engineering leadership • Mentor and grow team members as the team scales

🎯 Requirements

• Hands-on infrastructure engineering experience with Kubernetes or similar • Experience owning a system in production • Experience keeping model services operational across peak load, scaling, disaster recovery, and operational excellence • Direct experience with model-serving infrastructure and/or inference optimization for large models • Large-scale distributed systems experience, including scaling and reliability under production load • Comfort debugging distributed systems and production incidents under real traffic • Track record of shipping software end to end: design, build, and operate production systems • Ability to champion and enforce engineering best practices with dynamic product requirements • Ability to operate autonomously as an early lead engineer • Ability to mentor and grow team members • Preferred: Experience with vLLM, TensorRT-LLM, Triton, SGLang, or similar • Preferred: Exposure to GPU-cluster capacity planning or multi-region/multi-cloud deployment • Preferred: Exposure to ISO 27001, SOC 2, or comparable environments • Preferred: Familiarity with Rust, Go, or similar systems development languages • Preferred: Systems-level optimization involving rate-limiting, routing, and bottleneck identification

🏖️ Benefits

• Flexible work arrangements, including work from anywhere for up to 8 weeks per year • Flexible vacation • Two company-wide Mental Health Days off • Headspace app access • Retirement savings • Tuition reimbursement • Employee incentive programs • Resources for mental, physical, and financial wellbeing • Two paid volunteer days off annually • Pro-bono consulting projects and ESG initiatives • Health, dental, vision, disability, and life insurance programs • Competitive 401k plan with company match • Competitive vacation, sick and safe paid time off • Paid holidays, including two company mental health days off • Parental leave • Sabbatical leave • Optional hospital, accident and sickness insurance • Optional life and AD&D insurance • Flexible Spending and Health Savings Accounts • Fitness reimbursement • Employee Assistance Program • Group Legal Identity Theft Protection benefit • 529 Plan access • Commuter benefits • Adoption & Surrogacy Assistance • Employee Stock Purchase Plan • Annual Bonus eligibility based on enterprise and individual performance

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 30 minutes ago

Unisys

10,000+ employees

💼 Consulting

📦 Logistics

🤖 Artificial Intelligence

Windows Patching Engineer managing enterprise Windows Server patching for Unisys. Driving secure deployments, compliance reporting, automation, and vulnerability remediation across cloud and on-premises environments.

🔥 30 minutes ago

Unisys

10,000+ employees

💼 Consulting

📦 Logistics

🤖 Artificial Intelligence

Middleware Patching Engineer securing Unisys enterprise application platforms. Managing vulnerability-driven patching, automation, compliance, and recovery across cloud and on-premises environments.

🔥 38 minutes ago

Helix

51 - 200

🏥 Healthcare

🧬 Biotechnology

⚕️ Healthcare Insurance

Clinical Informatics Engineer III advancing Helix’s genomics-powered healthcare data infrastructure. Building OMOP pipelines and validating clinical outcomes for health system and life science partners.

🔥 38 minutes ago

Helix

51 - 200

🏥 Healthcare

🧬 Biotechnology

⚕️ Healthcare Insurance

Clinical Informatics Engineer III building OMOP clinical data infrastructure for Helix, a genomics healthcare company. Integrating EHR data and validating clinical outcomes for research partners.

🔥 50 minutes ago

TransGrid Energy

11 - 50

⚡ Energy

🤝 B2B

Interconnection Engineer leading utility and ISO/RTO grid integration for TransGrid Energy’s utility-scale battery, solar, hybrid, and data center projects.

🇺🇸 United States – Remote

💵 $110k - $145k / year

💰 $270M Private equity on 2025-03

⏰ Full Time

🟡 Mid-level

🟠 Senior

👷🏻‍♀️ Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok