Forward Deployed Engineer, AI Inference, vLLM, Kubernetes

🕒 May 20

🏄 California, New York, +3 more states – Remote

🏄 California – Remote 🗽 New York – Remote 🍂 Massachusetts – Remote 🤠 Texas – Remote ☕ Washington – Remote

💵 $184.9k - $342.5k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 Artificial Intelligence

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Red Hat

WebsiteLinkedInAll Job Openings

10,000+ employees

Founded 1993

🏢 Enterprise

💰 Corporate Round on 1999-03

Enterprise • Cloud

Red Hat is a leading provider of enterprise open source software solutions, helping companies worldwide to build and deploy applications across hybrid cloud infrastructures. With a strong focus on developing secure, stable, and innovative technologies, Red Hat offers a broad portfolio including products like Red Hat Enterprise Linux, Red Hat OpenShift, and Red Hat Ansible Automation Platform. These products support IT services on any infrastructure efficiently. Trusted by more than 90% of the U. S. Fortune 500, Red Hat empowers organizations to modernize their IT environments, leveraging open source communities to drive technological advancement.

📋 Description

• Orchestrate Distributed Inference: Deploy and configure LLM-D and vLLM on Kubernetes clusters. • Optimize for Production: Run performance benchmarks and tune vLLM parameters. • Code Side-by-Side: Work directly with customer engineers to write production-quality code. • Solve the "Unsolvable": Debug complex interactions between model architectures and hardware accelerators. • Feedback Loop: Channel field learnings back to product development.

🎯 Requirements

• 8+ Years of Engineering Experience • Customer Fluency • Bias for Action • Deep Kubernetes Expertise • AI Inference Proficiency • Systems Programming: Proficiency in Python and Go • Infrastructure as Code: Experience with Helm, Terraform, or similar tools • Cloud & GPU Hardware Fluency • Experience contributing to open-source AI infrastructure projects is a plus • Knowledge of Envoy Proxy or Inference Gateway (IGW) is a plus

🏖️ Benefits

• Comprehensive medical, dental, and vision coverage • Flexible Spending Account - healthcare and dependent care • Health Savings Account - high deductible medical plan • Retirement 401(k) with employer match • Paid time off and holidays • Paid parental leave plans for all new parents • Leave benefits including disability, paid family medical leave, and paid military leave • Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, and employee assistance program