Member of Technical Staff, Inference

🔥 0 minutes ago

🌏 Anywhere in the World

⏰ Full Time

🔴 Lead

🖥 Software Engineer

👻 Ghost score 13%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Inferact

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2025

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Inferact is a startup founded by the creators and core maintainers of vLLM, the leading open-source LLM inference engine. The company aims to accelerate AI progress by making model inference cheaper and faster, expanding vLLM's performance and support for emerging architectures and accelerator hardware. Inferact combines deep expertise at the intersection of models and hardware to provide inference infrastructure used by research labs, hyperscalers, and startups, while continuing to develop and contribute optimizations back to the open-source community.

📋 Description

• Push the boundaries of LLM and diffusion model serving • Work at the core of vLLM to optimize model execution across diverse hardware and architectures • Develop inference runtime innovations for mixture-of-experts, multimodal, and agentic architectures • Implement inference techniques and model architectures from research papers • Contribute performant and maintainable code • Debug complex machine-learning codebases • Directly improve how AI inference is run by making inference cheaper and faster

🎯 Requirements

• Bachelor's degree or equivalent experience in computer science, engineering, or similar • Deep understanding of transformer architectures and their variants • Strong programming skills in Python with experience in PyTorch internals • Experience with LLM inference systems such as vLLM, TensorRT-LLM, SGLang, or TGI • Ability to read and implement model architectures and inference techniques from research papers • Ability to contribute performant and maintainable code and debug in complex ML codebases • Preferred: deep understanding of KV-cache memory management, prefix caching, and hybrid model serving • Preferred: familiarity with RL frameworks and algorithms for LLMs • Preferred: experience with multimodal inference across audio, image, video, and text • Contributions to open-source ML or system infrastructure projects are preferred • Bonus: core feature implementation in vLLM or other inference engine projects • Bonus: contributions to vLLM integrations such as verl, OpenRLHF, Unsloth, or LlamaFactory • Bonus: widely-shared technical blogs or side projects on vLLM or LLM inference • Required application materials: resume, GitHub handle, and a link to a relevant personal project, open-source contribution, or technical blog post

🏖️ Benefits

• Competitive benefits appropriate to your location, including health coverage where applicable • Equity • Visa sponsorship on a case-by-case basis • Fully remote work • Timezone-flexible schedule with regular overlap with Pacific Time for critical syncs