Senior Software Architect – AI Systems, Networking

🕒 November 25, 2025

🇺🇸 United States – Remote

💵 $224k - $431.3k / year

⏰ Full Time

🔴 Lead

🤖 AI Engineer

Where this job comes from

Posted on NVIDIA's careers page ↗NVIDIA's careers page, not through a job board

First seen by Remote Rocketship November 25, 2025

Still open on NVIDIA's site. Checked 6 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Architect and implement high-performance communication and memory management libraries for distributed AI • Drive hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects • Profile and optimize data movement across GPU memory, system DRAM, NVMe, and network fabrics • Integrate networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM • Contribute to and maintain open-source projects • Mentor engineers • Conduct design reviews • Prototype experimental technologies to evaluate their viability • Own modules and projects end-to-end, from scoping research questions to shipping production code • Drive technical decisions and bring in ideas from research and industry

🎯 Requirements

• 12+ years in systems software and/or networking with demonstrated ownership of complex projects • MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field • Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect • Strong C/C++/Rust systems programming with comfort in performance profiling and low-level debugging • Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns • Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements • Knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3) • Background of Reinforcement Learning systems

🏖️ Benefits

• Competitive salaries • Comprehensive benefits package • Equity

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok