Senior Deep Learning Scientist, Multimodal Agentic RL

🕒 July 25

🏄 California – Remote

infoinfo

💵 $184k - $287.5k / year

⏰ Full Time

🟠 Senior

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 35%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding • Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases • Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments • Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success

🎯 Requirements

• Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math • 8+ years of relevant work experience • Excellent programming skills in Python • Strong fundamentals in scalable model development and deep learning frameworks like PyTorch • Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models • Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design • Hands-on experience in post-training multimodal models for omni-modality (audio-visual) reasoning, full-duplex voice chat, and human-AI interaction • Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines • Strong record of publications in top-tier AI and machine learning venues such as NeurIPS, ICML, ICLR, or CVPR • Validated experience training and deploying multimodal foundation models using large-scale distributed infrastructure • Experience applying deep reinforcement learning techniques to train multimodal agents in complex simulation or gaming environments • Background in audio/speech AI, especially audio language models or audio generation • Background in building embodied AI systems that integrate multimodal perception with backend action-fulfillment and long-horizon planning

🏖️ Benefits

• Equity • Comprehensive benefits package • Competitive salary

Apply Now

Similar Jobs

🕒 July 25

Eurofins

10,000+ employees

🍽️ Food & Beverage

🏥 Healthcare

📦 Logistics

Scientist Group Leader developing analytical methods for pharmaceutical ingredients at Eurofins Scientific. Leading analytical development and ensuring compliance with regulatory guidelines.

🕒 July 21

Revvity

10,000+ employees

🏥 Healthcare

💼 Consulting

📦 Logistics

Field Application Scientist driving sales success for Revvity Signals through customer engagement and software demonstrations. Collaborating with sales teams on customer needs and providing technical insights for product improvement.

🇺🇸 United States – Remote

💵 $100k - $125k / year

⏰ Full Time

🟠 Senior

🕒 July 20

Columbus Technologies and Services

501 - 1000

🚀 Aerospace

🎖️ Defense

🏥 Healthcare

Sr. Scientist in agricultural chemistry and plant toxicology conducting research and development remotely. Collaborating with teams to advance health outcomes in agricultural practices.

🇺🇸 United States – Remote

💵 $121k - $210k / year

⏰ Full Time

🟠 Senior

🕒 July 20

HMH

1001 - 5000

📚 Education

🛍️ eCommerce

Learning Scientist focusing on early literacy, applying research to develop learning models. Working remotely to support early education initiatives in diverse ways.

🕒 July 16

Columbus Technologies and Services

501 - 1000

🚀 Aerospace

🎖️ Defense

🏥 Healthcare

Senior Scientist specializing in immunology and nucleic acid therapeutics, supporting R&D programs. Collaborating with a team to drive innovative solutions for complex health issues.

🇺🇸 United States – Remote

💵 $121k - $210k / year

⏰ Full Time

🟠 Senior