Senior Solutions Architect, Inference Service Providers

🔥 0 minutes ago

🏄 California – Remote

🏄 California – Remote

💵 $184k - $356.5k / year

⏰ Full Time

🟠 Senior

💻 Solutions Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 1%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Work with inference partners building cutting-edge inference services, teach them the value of NVIDIA's stack, and bring back product insights • Build and operate inference recipes with NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency • Accelerate inference pipelines using TensorRT-LLM, vLLM, SGLang, and other backends • Evangelize DevOps best practices for managing Kubernetes clusters, configuring compute fabrics, and observability • Provide mentorship and technical leadership to customers and internal teams • Guide deployment of disaggregated inference systems and resolve complex issues • Write reference architectures adopted by 10k+ GPU clusters • Teach C-level executives, distinguished engineers, and datacenter developers how to scale businesses, systems, and infrastructure

🎯 Requirements

• 6+ Years in Solutions Architecture (or Solution Engineering, Forward-Deployed Engineering, or similar) driving customer engagements to deploy distributed systems, including 2+ years with AI workloads on Kubernetes • Experience with one of NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization and serving • Deep knowledge of modern inference best practices including disaggregated serving, multi-tier KV cache management, speculative decoding, quantization and custom inference kernels • Hands-on full-stack agent design with modern sandboxing, memory and retrieval systems with evaluation, skill design and governance • BS in CS/Engineering or equivalent experience • Prior experience deploying NVIDIA inference technologies such as Dynamo, NIXL and Grove • Experience with model customization techniques such as SFT, DPO, GRPO, RLVR and corresponding data curation techniques • Contributions to open-source projects relevant to the above

🏖️ Benefits

• Highly competitive salaries • Comprehensive benefits package • Equity