Senior Deep Learning Scientist, Multimodal Agentic RL

🕒 July 25

🏄 California – Remote

🏄 California – Remote

💵 $184k - $287.5k / year

⏰ Full Time

🟠 Senior

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 11%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

NVIDIA

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding • Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases • Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments • Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success • Define core algorithmic improvements for multimodal foundation models through the Nemotron Omni and VoiceChat platforms • Develop high-impact large language models and multimodal AI products

🎯 Requirements

• Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math • 8+ years of relevant work experience • Excellent programming skills in Python • Strong fundamentals in scalable model development • Experience with deep learning frameworks like PyTorch • Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models • Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design • Hands-on experience in post-training multimodal models for omni-modality (audio-visual) reasoning, full-duplex voice chat, and human-AI interaction • Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines • Strong record of publications in top-tier AI and machine learning venues such as NeurIPS, ICML, ICLR, or CVPR • Validated experience training and deploying multimodal foundation models using large-scale distributed infrastructure • Experience applying deep reinforcement learning techniques to train multimodal agents in complex simulation or gaming environments • Background in audio/speech AI, especially audio language models or audio generation • Background in building embodied AI systems that integrate multimodal perception with backend action-fulfillment and long-horizon planning

🏖️ Benefits

• Equity • Comprehensive benefits package • Benefits for you and your family