Senior Software Engineer – AI Inference

🕒 July 16

🏄 California, New York, +1 more states – Remote

info

💵 $152k - $241.5k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

info
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🏥 Healthcare

🏭 Manufacturing

🤖 Artificial Intelligence

Healthcare • Manufacturing • Artificial Intelligence

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Contribute features, fixes, and optimizations upstream to vLLM/SGLang • Implement and optimize inference‑runtime capabilities • Profile and improve hot paths across layers • Improve multi‑GPU inference performance and reliability • Build and maintain performance and correctness regression tests • Collaborate with model, platform, and SRE teams

🎯 Requirements

• 5+ years building production software with solid systems engineering fundamentals • Experience with LLM inference/serving stacks (e.g., vLLM, SGLang) • Strong programming skills in Python plus C++ and/or CUDA • Experience with profiling and performance investigation • Familiarity with distributed systems concepts and concurrency • BS/MS in Computer Science, Computer Engineering, or related field (or equivalent experience)

🏖️ Benefits

• equity • benefits

Apply Now

Similar Jobs

🕒 July 16

phData

201 - 500

💼 Consulting

🏥 Healthcare

🏭 Manufacturing

Full-stack engineer building AI-native applications and agents to solve business problems for clients at phData. Collaborating closely with stakeholders to drive measurable outcomes.

🇺🇸 United States – Remote

💰 $2.5M Seed Round on 2018-03

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

info

🕒 July 16

pulsESG

11 - 50

☁️ SaaS

🌍 Social Impact

AI Engineer specializing in Large Language Models at Pulsora, a startup focusing on enterprise sustainability. Lead development of AI-driven applications and complex workflows.

🇺🇸 United States – Remote

💵 $50k - $60k / year

💰 Venture Round on 2022-11

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

Java

Numpy

Pandas

Python

React

Scikit-Learn

🕒 July 15

SentinelOne

1001 - 5000

💼 Consulting

🏥 Healthcare

📦 Logistics

Senior Staff Forward Deployed Engineer, AI at SentinelOne integrating engineering with departments needing support. Design and deliver custom applications for internal stakeholders rapidly.

🇺🇸 United States – Remote

💵 $184k - $253k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

info

🕒 July 15

Torc Robotics

501 - 1000

🚘 Automotive

📦 Logistics

🚗 Transport

Senior Software Engineer on ML Ops team developing AI tooling for autonomous vehicle technology. Involves project management, collaboration, and technical expertise in machine learning processes.

🇺🇸 United States – Remote

💵 $160.8k - $193k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

info

🕒 July 15

OpenRouter

1 - 10

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Applied AI Engineer creating workflows for the AI routing platform OpenRouter. Focused on building tools to support operations and go-to-market strategies.

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer