Senior Software Engineer, Open Harness Engineering

Job not on LinkedIn

🔥 0 minutes ago

🏄 California, Colorado, +3 more states – Remote

infoinfo

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 1%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Define and evolve the technical approach for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments • Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis • Diagnose agent failures from traces, logs, tool results, and benchmark artifacts • Separate harness, evaluator, environment, inference, and model causes • Design controlled experiments and promotion criteria to distinguish genuine harness improvements from noise, benchmark artifacts, or model-specific gains • Ship harness and runtime improvements, including upstream open-source contributions, detectors, regression tests, and maintainable documentation • Partner with Relay, Hermes, model, infrastructure, and research teams to turn recurring optimization needs into reusable runtime, trace, and evaluation capabilities

🎯 Requirements

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience • 8+ years of hands-on software-engineering experience • Demonstrated technical ownership of production systems • Architecture design leadership • Expert Python skills • Working proficiency in Rust, Go, C++, or TypeScript • Ability to debug systems across language and process boundaries • Experience building or extending LLM agents, coding agents, tool-use loops, model-provider integrations, developer tools, or evaluation infrastructure • Understanding of asynchronous execution, subprocesses, containers, sandboxing, callbacks, retries, networking, and distributed compute • Experience crafting reproducible experiments, benchmark methodology, performance investigations, regression gates, or reliability analysis under nondeterministic conditions • Record of shipping and maintaining open-source or developer-facing software with sound testing, API development, documentation, and code reviews

🏖️ Benefits

• Highly competitive salaries • Comprehensive benefits package • Equity

Apply Now

Similar Jobs

🔥 2 hours ago

Lean Focus

51 - 200

📣 Marketing

💼 Consulting

🏢 Enterprise

Software Engineer building TypeScript, GraphQL, AWS, and Java solutions. Delivering maintainable applications and guiding client teams in modern software development.

🔥 6 hours ago

Prelim

11 - 50

💸 Finance

💳 Fintech

☁️ SaaS

Software Engineer building scalable onboarding infrastructure for banks at Prelim. Developing integrations and product features handling millions of financial applications.

🔥 7 hours ago

Kapitus

201 - 500

💸 Finance

💳 Fintech

🤝 B2B

Software Engineer II building Python and AWS platforms for Kapitus, a small-business lender. Replacing legacy systems and developing scalable internal customer interfaces.

🔥 7 hours ago

Palo Alto Networks

10,000+ employees

🔒 Cybersecurity

🏢 Enterprise

Sr. Staff Engineer building Chronosphere’s scalable telemetry collection and ingestion platform. Developing Go-based distributed systems for Palo Alto Networks’ observability product.

🔥 7 hours ago

Zillow

5001 - 10000

🏠 Real Estate

🛍️ eCommerce

👥 B2C

Fullstack engineer building scalable web applications and APIs for Zillow’s real estate platform. Applying Gen AI, NLP, computer vision, and LLM technologies across the software lifecycle.