Senior Software Engineer, AI Frameworks

πŸ•’ March 31

Where this job comes from

Posted on NVIDIA's careers page β†—NVIDIA's careers page, not through a job board

First seen by Remote Rocketship March 31

Still open on NVIDIA's site. Checked 3 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

πŸ₯ Healthcare

🏭 Manufacturing

πŸ€– Artificial Intelligence

Healthcare β€’ Manufacturing β€’ Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

πŸ“‹ Description

β€’ Drive integration of the NVIDIA Grove project within Dynamo and across leading open-source AI frameworks β€’ Develop production-grade software enabling Grove capabilities to be adopted, scaled, and operated across environments such as Dynamo, llm-d, Ray, PyTorch, and other AI frameworks β€’ Design and implement end-to-end Grove integrations with open-source AI frameworks β€’ Build and maintain adapters, plugins, operators, and/or runtime components for training and inference stacks β€’ Partner with framework owners to upstream changes, contribute patches, and maintain integrations β€’ Develop reference workflows, sample applications, and best-practice guides β€’ Optimize performance, scalability, and reliability for distributed training/inference in multi-node and multi-GPU environments β€’ Improve observability and operational readiness for Kubernetes-based deployments through metrics, logging, tracing, and debugging tools β€’ Participate in technical design reviews, define APIs/contracts, and ensure compatibility across framework and dependency versions β€’ Diagnose issues involving containers, networking, scheduling, CUDA/GPU utilization, and framework runtime behavior β€’ Collaborate across engineering teams and the open-source community to deliver integrations, reference implementations, and developer tooling

🎯 Requirements

β€’ BS/MS/PhD in Computer Science, Electrical Engineering, or related field (or equivalent experience) β€’ 5+ years of proven experience in related field β€’ Hands-on experience integrating with at least one major AI framework/runtime (e.g., PyTorch, Ray, Triton Inference Server ecosystem, distributed runtimes, model serving stacks) β€’ Solid understanding of AI workloads: model development basics, training vs. inference tradeoffs, and performance considerations (throughput/latency, batching, memory) β€’ Experience with distributed systems concepts (RPC, scheduling, fault tolerance, resource management) β€’ Practical Kubernetes experience: deploying and operating services/jobs, Helm/Kustomize, operators/controllers (nice to have), and debugging clusters β€’ Familiarity with containers and cloud-native tooling (Docker, container registries, CI/CD pipelines) β€’ Strong software engineering experience in Go, C++ and/or Python, with a track record of shipping reliable systems β€’ Strong interpersonal skills and ability to collaborate across teams and with open-source communities β€’ Exceptional collaboration, communication, and documentation habits β€’ Open-source contributions to Dynamo, PyTorch, Ray, llm-d, Kubernetes ecosystem, or related ML infrastructure projects (standout) β€’ Experience with large-scale model serving, distributed inference, or multi-tenant AI platforms (standout) β€’ Experience building SDKs/APIs or developer tooling that improves integration usability (standout) β€’ Knowledge of GPU performance profiling and optimization (Nsight tools or similar), and/or kernel-level performance tuning (standout) β€’ Experience with reproducibility, packaging, versioning, and compatibility testing across fast-moving dependencies (standout)

πŸ–οΈ Benefits

β€’ Equity β€’ Benefits

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ March 31

Intras Cloud Services

11 - 50

πŸ₯ Healthcare

🏨 Hospitality

πŸ“¦ Logistics

AI Architect defining AI architecture and deploying intelligent agents for Intras Cloud Services. Leading the transformation into a Managed Intelligence Provider with a focus on agentic AI systems.

πŸ•’ March 31

Team8

51 - 200

πŸ’Ό Consulting

πŸ₯ Healthcare

🏭 Manufacturing

Payment Accuracy and Concept Lead identifying errors in medical billing through the Bluespine platform. Collaborating with medical coders and engineering teams for enhancing audit concepts.

πŸ•’ March 28

Strange Loop Labs

11 - 50

πŸ€– Artificial Intelligence

🏒 Enterprise

⚑ Productivity

AI Engineer at Strange Loop developing an AI agent platform. Collaborating with major companies to automate workflows and improve efficiency.

πŸ•’ March 27

Elicit

11 - 50

πŸ“š Education

πŸ€– Artificial Intelligence

βš•οΈ Healthcare Insurance

AI Engineer developing backend systems focusing on language model interactions for Elicit's AI research assistant. Collaborating with a small team to deliver high-quality product features.

πŸ•’ March 27

Kraken Digital Asset Exchange

1001 - 5000

β‚Ώ Crypto

πŸ’Έ Finance

πŸ’³ Fintech

Senior Software Engineer building high-scale Rust infrastructure for Kraken’s AI agents. Operating ML inference, orchestration, and execution systems for a global crypto finance platform.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok