Search Remote Jobs

Senior Software Architect – AI Systems, Networking

🕒 November 25, 2025

🏄 California, Texas – Remote

infoinfo

💵 $224k - $431.3k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

Where this job comes from

Posted on NVIDIA's careers page, not through a job board

First seen by Remote Rocketship November 25, 2025

Still open on NVIDIA's site. Checked 7 hours ago.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Architect and implement high-performance communication and memory management libraries for distributed AI • Drive hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects • Profile and optimize data movement across GPU memory, system DRAM, NVMe, and network fabrics • Integrate networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM • Contribute to and maintain open-source projects • Mentor engineers • Conduct design reviews • Prototype experimental technologies to evaluate their viability • Own modules and projects end-to-end, from scoping research questions to shipping production code • Drive technical decisions and bring in ideas from research and industry

🎯 Requirements

• 12+ years in systems software and/or networking with demonstrated ownership of complex projects • MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field • Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect • Strong C/C++/Rust systems programming with comfort in performance profiling and low-level debugging • Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns • Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements • Knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3) • Background of Reinforcement Learning systems

🏖️ Benefits

• Competitive salaries • Comprehensive benefits package • Equity

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 November 25, 2025

Oneleet

51 - 200

📋 Compliance

🔒 Cybersecurity

☁️ SaaS

Fullstack Engineer focused on AI Integration at Oneleet, working across the stack to enhance cybersecurity platform with AI features.

🕒 November 24, 2025

Advancio

51 - 200

💼 Consulting

📣 Marketing

📦 Logistics

AI Developer designing and deploying intelligent solutions for businesses at Advancio, Inc. Collaborating with teams and using AI/ML technologies to solve complex problems.

🕒 November 22, 2025

Vanta

201 - 500

📋 Compliance

🔐 Security

☁️ SaaS

Senior Applied AI Engineer at Vanta shaping AI offerings and leading projects leveraging AI for compliance. Collaborating with cross-functional product teams to enhance customer outcomes.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok