Senior Software Engineer – AI Inference

🔥 16 hours ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of NVIDIA

NVIDIA

10,000+ employees

Founded 1993

🤖 Artificial Intelligence

🎮 Gaming

Artificial Intelligence • Gaming • Automotive

NVIDIA is a leading technology company specializing in accelerated computing and artificial intelligence. NVIDIA pioneers advancements in graphical processing units (GPUs), cloud computing, data centers, and virtual reality, with a focus on gaming, automotive, healthcare, and robotics industries. The company's innovations, such as NVIDIA Omniverse, transform traditional digital processes by enabling high-fidelity simulations and rendering tasks. Their applications span various industries, from autonomous vehicles using NVIDIA DRIVE to healthcare solutions with NVIDIA Clara, and AI-driven analytics and workflows.

📋 Description

• Contribute features, fixes, and optimizations upstream to vLLM/SGLang • Implement and optimize inference‑runtime capabilities • Profile and improve hot paths across layers • Improve multi‑GPU inference performance and reliability • Build and maintain performance and correctness regression tests • Collaborate with model, platform, and SRE teams

🎯 Requirements

• 5+ years building production software with solid systems engineering fundamentals • Experience with LLM inference/serving stacks (e.g., vLLM, SGLang) • Strong programming skills in Python plus C++ and/or CUDA • Experience with profiling and performance investigation • Familiarity with distributed systems concepts and concurrency • BS/MS in Computer Science, Computer Engineering, or related field (or equivalent experience)

🏖️ Benefits

• equity • benefits

Apply Now

Similar Jobs

🔥 19 hours ago

phData

201 - 500

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

Full-stack engineer building AI-native applications and agents to solve business problems for clients at phData. Collaborating closely with stakeholders to drive measurable outcomes.

🔥 20 hours ago

pulsESG

11 - 50

AI Engineer specializing in Large Language Models at Pulsora, a startup focusing on enterprise sustainability. Lead development of AI-driven applications and complex workflows.

🇺🇸 United States – Remote

💵 $50k - $60k / year

💰 Venture Round on 2022-11

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 Yesterday

UFS Tech

51 - 200

🔒 Cybersecurity

💳 Fintech

Lead AI/ML Engineer developing the Navanta AI platform by building retrieval systems and evaluation metrics. Collaborate with product teams, ensuring compliance and groundedness in banking environments.

🕒 Yesterday

IFS

5001 - 10000

🏢 Enterprise

☁️ SaaS

🤖 Artificial Intelligence

AI Adoption Lead responsible for customer success and AI integration in enterprise software. Leading the strategy and execution of AI adoption initiatives for Nexus Black.

🕒 Yesterday

Mercy

10,000+ employees

🤝 Non-profit

🧘 Wellness

Responsible AI Program Lead at Mercy translating Responsible AI standards into actionable workflows. Supports governance activities and engages with cross-functional teams for effective execution.