Principal Software Engineer – E2E Performance, Goodput

🕒 November 7

💵 $272k - $431.3k / year

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

Where this job comes from

Posted on NVIDIA's careers page ↗NVIDIA's careers page, not through a job board

First seen by Remote Rocketship November 7

Still open on NVIDIA's site. Checked 4 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Drive performance characterization work streams with engineering teams of key CSP/hyperscale customers, ensuring understanding of platform performance expectations, profiling methodology, and tuning options for specific workloads • Gather and synthesize CSP performance feedback, identify gaps between expected and actual throughput, and champion optimization priorities to NVIDIA's CUDA, NCCL, driver, and firmware teams • Ensure open-source performance and stress tools such as STREAM, GPU Burn, and GPU BLAST are updated and validated for the latest NVIDIA rack-scale systems, GPU architectures, and CPU platforms • Work with CSPs to ensure their performance and validation tooling reflects the latest GPU capabilities, memory hierarchy changes, and platform-specific tuning parameters • Conduct cross-CSP performance comparison and pattern analysis to identify configuration, software, or workload differences explaining deployment performance gaps • Collaborate with CSPs to prepare profiling infrastructure, benchmark harnesses, and configuration validation for deployment milestones • Define test strategies and tooling requirements for performance validation for NVIDIA internal certification and customer acceptance

🎯 Requirements

• 15+ years of experience in systems performance engineering, ideally in GPU/HPC/ML infrastructure • BS or MS in Computer Science, Computer Engineering, or related field (or equivalent experience) • Proficiency in GPU workload profiling: nsight systems, nsight compute, DCGM metrics, or equivalent instrumentation • Understanding of distributed training performance dynamics: computation/communication overlap, pipeline bubbles, memory bandwidth utilization, collective efficiency • Statistical methods for performance analysis: regression detection, confidence intervals, A/B comparison at scale • Understanding of how the full software stack impacts performance: driver overhead, collective algorithm selection, memory allocation, scheduling, firmware power management • Strong data analysis and visualization skills (Python, pandas, dashboards) • Ability to communicate performance findings to both deep technical audiences and executive leadership • Demonstrated success influencing multiple engineering teams to prioritize performance improvements • Experience profiling and optimizing distributed training at 1000+ GPU scale (Megatron-LM, DeepSpeed, FSDP) • Background in ML infrastructure performance at a CSP/hyperscaler • Familiarity with NVIDIA platforms (DGX, HGX, NVLink topology) and profiling tools • Experience building automated performance regression detection systems for production environments • Understanding of inference workload performance dynamics (vLLM, TensorRT-LLM, SGLang, continuous batching)

🏖️ Benefits

• Equity • Benefits

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 November 7

8th Light

51 - 200

💼 Consulting

📣 Marketing

Principal Software Engineer building scalable AI platforms and software solutions for 8th Light’s consulting clients. Advising executives, leading architecture, and coaching engineering teams.

🇺🇸 United States – Remote

💵 $151.5k - $220.9k / year

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

🕒 November 7

Cresta

51 - 200

☁️ SaaS

🤖 Artificial Intelligence

🏢 Enterprise

AI Growth Engineer building marketing AI agents, websites, and interactive campaign experiences. Cresta’s unified AI platform helps companies improve customer experiences, revenue, and efficiency.

🇺🇸 United States – Remote

💵 $160k - $280k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🧑‍💻 Full-stack Engineer

🕒 November 6

MOXFIVE

11 - 50

💼 Consulting

🏥 Healthcare

🛡️ Insurance

Staff Engineer building MOXFIVE's AI-powered cyber investigation platform. Designing agent capabilities, evaluations, distributed systems, and resilient data infrastructure.

🇺🇸 United States – Remote

💵 $200k - $250k / year

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

🕒 November 6

Bugcrowd

201 - 500

💼 Consulting

🏥 Healthcare

📦 Logistics

Staff Engineer advancing ARM and AArch64 emulation for Bugcrowd’s AI-powered security platform. Improving binary analysis, fuzzing, firmware support, and execution reliability.

🇺🇸 United States – Remote

💵 $96 - $133 / hour

💰 $30M Series D on 2020-04

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

Assembly

Linux

C++

🕒 November 6

Fanatics Betting & Gaming

-

🎲 Gambling

⚽ Sports

👥 B2C

Staff Engineer owning shared ledger and balance services for Fanatics’ sports betting and gaming platform. Designing auditable financial systems and leading migrations across business units.

🇺🇸 United States – Remote

💵 $190k - $237.5k / year

⏰ Full Time

🔴 Lead

🧑‍💻 Full-stack Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok