Senior Software Engineer, Open Harness Engineering

🕒 September 1

🏄 California, Colorado, +3 more states – Remote

infoinfo

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Define and evolve the technical approach for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments • Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis • Diagnose agent failures from traces, logs, tool results, and benchmark artifacts • Separate harness, evaluator, environment, inference, and model causes • Design controlled experiments and promotion criteria to distinguish genuine harness improvements from noise, benchmark artifacts, or model-specific gains • Ship focused harness and runtime improvements, including upstream open-source contributions, detectors, regression tests, and maintainable documentation • Partner with Relay, Hermes, model, infrastructure, and research teams to turn recurring optimization needs into reusable runtime, trace, and evaluation capabilities

🎯 Requirements

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience • 8+ years of hands-on software-engineering experience • Demonstrated technical ownership of production systems • Architecture design leadership • Expert Python skills • Working proficiency in Rust, Go, C++, or TypeScript • Ability to debug systems across language and process boundaries • Experience building or extending LLM agents, coding agents, tool-use loops, model-provider integrations, developer tools, or evaluation infrastructure • Understanding of asynchronous execution, subprocesses, containers, sandboxing, callbacks, retries, networking, and distributed compute • Experience crafting reproducible experiments, benchmark methodology, performance investigations, regression gates, or reliability analysis under nondeterministic conditions • Record of shipping and maintaining open-source or developer-facing software with sound testing, API development, documentation, and code reviews

🏖️ Benefits

• Highly competitive salaries • Comprehensive benefits package • Equity • Benefits

Apply Now

Similar Jobs

🕒 September 1

Prelim

11 - 50

💸 Finance

💳 Fintech

☁️ SaaS

Software Engineer building scalable onboarding infrastructure for banks at Prelim. Developing integrations and product features handling millions of financial applications.

🕒 September 1

Kapitus

201 - 500

💸 Finance

💳 Fintech

🤝 B2B

Software Engineer II building Python and AWS platforms for Kapitus, a small-business lender. Replacing legacy systems and developing scalable internal customer interfaces.

🕒 August 31

Zillow

5001 - 10000

🏠 Real Estate

🛍️ eCommerce

👥 B2C

Fullstack engineer building scalable web applications and APIs for Zillow’s real estate platform. Applying Gen AI, NLP, computer vision, and LLM technologies across the software lifecycle.

🕒 August 31

Archera

11 - 50

💼 Consulting

📦 Logistics

Senior Fullstack Software Engineer building customer-facing FinTech products for Archera’s cloud cost optimization platform. Owning React, TypeScript, Python APIs, services, and data end to end.

🕒 August 31

Qualus

1001 - 5000

🏗️ Construction

📦 Logistics

🏭 Manufacturing

Senior Distribution Engineer leading overhead and underground utility distribution projects for Qualus, a power infrastructure solutions firm. Developing designs, reviewing deliverables, and mentoring engineering teams.