Senior Solutions Architect, Inference Service Providers

πŸ•’ August 21

Where this job comes from

Posted on NVIDIA's careers page β†—NVIDIA's careers page, not through a job board

First seen by Remote Rocketship August 21

Still open on NVIDIA's site. Checked 3 hours ago.

Apply Now
Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

πŸ₯ Healthcare

🏭 Manufacturing

πŸ€– Artificial Intelligence

Healthcare β€’ Manufacturing β€’ Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

πŸ“‹ Description

β€’ Work with inference partners building cutting-edge inference services, teach them the value of NVIDIA's stack, and bring back product insights β€’ Build and operate inference recipes with NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency β€’ Accelerate inference pipelines using TensorRT-LLM, vLLM, SGLang, and other backends β€’ Evangelize DevOps best practices for managing Kubernetes clusters, configuring compute fabrics, and observability β€’ Provide mentorship and technical leadership to customers and internal teams β€’ Guide deployment of disaggregated inference systems and resolve complex issues β€’ Write reference architectures adopted by 10k+ GPU clusters β€’ Teach C-level executives, distinguished engineers, and datacenter developers how to scale businesses, systems, and infrastructure

🎯 Requirements

β€’ 6+ Years in Solutions Architecture (or Solution Engineering, Forward-Deployed Engineering, or similar) driving customer engagements to deploy distributed systems, including 2+ years with AI workloads on Kubernetes β€’ Experience with one of NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization and serving β€’ Deep knowledge of modern inference best practices including disaggregated serving, multi-tier KV cache management, speculative decoding, quantization and custom inference kernels β€’ Hands-on full-stack agent design with modern sandboxing, memory and retrieval systems with evaluation, skill design and governance β€’ BS in CS/Engineering or equivalent experience β€’ Prior experience deploying NVIDIA inference technologies such as Dynamo, NIXL and Grove β€’ Experience with model customization techniques such as SFT, DPO, GRPO, RLVR and corresponding data curation techniques β€’ Contributions to open-source projects relevant to the above

πŸ–οΈ Benefits

β€’ Highly competitive salaries β€’ Comprehensive benefits package β€’ Equity

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ August 21

Traversal

11 - 50

πŸ€– Artificial Intelligence

☁️ SaaS

🀝 B2B

Solutions Engineer guiding enterprise customers from technical discovery through deployment. Helping Traversal scale sales of its AI-powered SRE infrastructure platform.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $150k - $300k / year

πŸ’° Seed on 2025-07

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ’» Solutions Engineer

πŸ•’ August 21

Presidio

1001 - 5000

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Solution Architect designing end-to-end AI architectures for Presidio, a digital technology and cloud solutions provider. Translating customer needs into technical proposals and scalable enterprise solutions.

πŸ•’ August 21

Claroty

501 - 1000

🍽️ Food & Beverage

🏭 Manufacturing

πŸ“¦ Logistics

Solutions Engineer designing Claroty OT cybersecurity solutions for industrial, healthcare, energy, and critical infrastructure customers. Leading technical discovery, demonstrations, PoCs, and RFP responses.

πŸ•’ August 21

Impiricus

11 - 50

πŸ₯ Healthcare

πŸ’Ό Consulting

🍽️ Food & Beverage

Product Solutions Architect shaping demos, architectures, and implementations for Impiricus’s AI-powered HCP engagement platform. Translating pharma client needs into scalable Ascend solutions.

πŸ•’ August 21

Delta Electronics

10,000+ employees

🏭 Manufacturing

⚑ Energy

πŸ”§ Hardware

Solution Integration Engineer validating hardware, software, and data center infrastructure for Delta, a global power and thermal management solutions provider. Testing integration, performance, reliability, and deployment readiness.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok