Senior Software Engineer, Open Harness Engineering

πŸ•’ September 1

Where this job comes from

Posted on NVIDIA's careers page β†—NVIDIA's careers page, not through a job board

First seen by Remote Rocketship September 1

Still open on NVIDIA's site. Checked 3 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

πŸ₯ Healthcare

🏭 Manufacturing

πŸ€– Artificial Intelligence

Healthcare β€’ Manufacturing β€’ Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

πŸ“‹ Description

β€’ Define and evolve the technical approach for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments β€’ Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis β€’ Diagnose agent failures from traces, logs, tool results, and benchmark artifacts β€’ Separate harness, evaluator, environment, inference, and model causes β€’ Design controlled experiments and promotion criteria to distinguish genuine harness improvements from noise, benchmark artifacts, or model-specific gains β€’ Ship focused harness and runtime improvements, including upstream open-source contributions, detectors, regression tests, and maintainable documentation β€’ Partner with Relay, Hermes, model, infrastructure, and research teams to turn recurring optimization needs into reusable runtime, trace, and evaluation capabilities

🎯 Requirements

β€’ Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience β€’ 8+ years of hands-on software-engineering experience β€’ Demonstrated technical ownership of production systems β€’ Architecture design leadership β€’ Expert Python skills β€’ Working proficiency in Rust, Go, C++, or TypeScript β€’ Ability to debug systems across language and process boundaries β€’ Experience building or extending LLM agents, coding agents, tool-use loops, model-provider integrations, developer tools, or evaluation infrastructure β€’ Understanding of asynchronous execution, subprocesses, containers, sandboxing, callbacks, retries, networking, and distributed compute β€’ Experience crafting reproducible experiments, benchmark methodology, performance investigations, regression gates, or reliability analysis under nondeterministic conditions β€’ Record of shipping and maintaining open-source or developer-facing software with sound testing, API development, documentation, and code reviews

πŸ–οΈ Benefits

β€’ Highly competitive salaries β€’ Comprehensive benefits package β€’ Equity β€’ Benefits

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ September 1

Collectors

1001 - 5000

πŸ’Ό Consulting

πŸ“£ Marketing

πŸ›οΈ eCommerce

Principal Software Engineer building scalable Python and AWS backends for Collectors’ PSA Set Registry. Supporting a digital collectibles platform used by hundreds of thousands of collectors.

πŸ•’ September 1

Prelim

11 - 50

πŸ’Έ Finance

πŸ’³ Fintech

☁️ SaaS

Software Engineer building scalable onboarding infrastructure for banks at Prelim. Developing integrations and product features handling millions of financial applications.

πŸ•’ August 31

Clever Real Estate

51 - 200

🏠 Real Estate

πŸͺ Marketplace

πŸ‘₯ B2C

Full-stack engineer owning Python/Django and React/TypeScript products at Clever, a real estate technology company. Delivering reliable customer and operational solutions with AI-assisted engineering.

πŸ•’ August 31

Archera

11 - 50

πŸ’Ό Consulting

πŸ“¦ Logistics

Senior Fullstack Software Engineer building customer-facing FinTech products for Archera’s cloud cost optimization platform. Owning React, TypeScript, Python APIs, services, and data end to end.

πŸ•’ August 31

State of New Jersey

10,000+ employees

πŸ›οΈ Government

Senior full-stack engineer building innovative digital services for New Jersey residents. Delivering accessible, human-centered products across the full development stack.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok