Lead Machine Learning Engineer, Inference – Performance

🕒 July 1

🇺🇸 United States – Remote

💵 $159.3k - $250.1k / year

⏰ Full Time

🟠 Senior

🤖 Machine Learning Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Egen

WebsiteLinkedInAll Job Openings

501 - 1000 employees

Founded 2000

🤖 Artificial Intelligence

Artificial Intelligence • Healthcare • Public Sector

Egen is a company that specializes in engineering innovative solutions using platforms, data, and generative AI. They focus on harnessing the potential of data to empower organizations and individuals, providing services across various sectors including communications, healthcare, and public sector solutions. Their customizable platforms address critical challenges in urban management, customer engagement, clinical care, and operational excellence, aiming to drive impactful outcomes for clients.

📋 Description

• Optimize Inference: Build and tune production LLM serving with vLLM and SGLang • Profile & Accelerate Training: Instrument and profile training runs to find bottlenecks • Engineer for the Hardware: Apply a working understanding of GPU architecture • Serve at Scale: Deploy and operate multiple models within shared GPU clusters on GKE • Drive Efficiency: Own GPU utilization as a first-class metric • Collaborate & Consult: Work directly with clients to understand performance requirements

🎯 Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field • 5+ years of experience in ML/AI engineering, with a meaningful portion focused on performance, infrastructure, or systems • Proven track record of deploying and optimizing models in a production environment • Demonstrated experience profiling and improving GPU utilization for training and/or inference • Experience with Classic Machine Learning (neural nets, training, tuning) is a strong plus • Knowledge of Data Engineering and SQL

🏖️ Benefits

• Comprehensive Health Insurance • Paid Leave (Vacation/PTO) • Paid Holidays • Sick Leave • Parental Leave • Bereavement Leave • 401 (k) Employer Match • Employee Referral Bonuses