Member of Technical Staff, Inference

🕒 September 4

🌏 Anywhere in the World

⏰ Full Time

🟠 Senior

🖥 Software Engineer

Where this job comes from

Posted on Inferact's careers page ↗Inferact's careers page, not through a job board

First seen by Remote Rocketship September 4

Still open on Inferact's site. Checked 5 hours ago.

Apply Now
Logo of Inferact

Inferact

11 - 50 employees

Founded 2025

🤖 Artificial Intelligence

🤝 B2B

🏢 Enterprise

Artificial Intelligence • B2B • Enterprise

Inferact is a startup founded by the creators and core maintainers of vLLM, the leading open-source LLM inference engine. The company aims to accelerate AI progress by making model inference cheaper and faster, expanding vLLM's performance and support for emerging architectures and accelerator hardware. Inferact combines deep expertise at the intersection of models and hardware to provide inference infrastructure used by research labs, hyperscalers, and startups, while continuing to develop and contribute optimizations back to the open-source community.

📋 Description

• Push the boundaries of LLM and diffusion model serving • Work at the core of vLLM to optimize model execution across diverse hardware and architectures • Develop inference runtime innovations for mixture-of-experts, multimodal, and agentic architectures • Implement inference techniques and model architectures from research papers • Contribute performant and maintainable code • Debug complex machine-learning codebases • Directly improve how AI inference is run by making inference cheaper and faster

🎯 Requirements

• Bachelor's degree or equivalent experience in computer science, engineering, or similar • Deep understanding of transformer architectures and their variants • Strong programming skills in Python with experience in PyTorch internals • Experience with LLM inference systems such as vLLM, TensorRT-LLM, SGLang, or TGI • Ability to read and implement model architectures and inference techniques from research papers • Ability to contribute performant and maintainable code and debug in complex ML codebases • Preferred: deep understanding of KV-cache memory management, prefix caching, and hybrid model serving • Preferred: familiarity with RL frameworks and algorithms for LLMs • Preferred: experience with multimodal inference across audio, image, video, and text • Contributions to open-source ML or system infrastructure projects are preferred • Bonus: core feature implementation in vLLM or other inference engine projects • Bonus: contributions to vLLM integrations such as verl, OpenRLHF, Unsloth, or LlamaFactory • Bonus: widely-shared technical blogs or side projects on vLLM or LLM inference • Required application materials: resume, GitHub handle, and a link to a relevant personal project, open-source contribution, or technical blog post

🏖️ Benefits

• Competitive benefits appropriate to your location, including health coverage where applicable • Equity • Visa sponsorship on a case-by-case basis • Fully remote work • Timezone-flexible schedule with regular overlap with Pacific Time for critical syncs

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 July 30

Mundo Devops

-

💼 Consulting

🤝 B2B

React Native Developer designing and developing high-quality software solutions. Collaborating remotely on complete software lifecycle and client presentations.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 July 29

Twindo

51 - 200

🏗️ Construction

☁️ SaaS

🤝 B2B

Twindo is revolutionizing remodeling and design through cutting-edge AI technology in a global virtual-first company. Interested candidates can send their resumes for future opportunities.

🕒 July 28

Trust Wallet

51 - 200

₿ Crypto

🌐 Web 3

Senior Mobile Engineer developing React Native applications for Trust Wallet, a global leader in cryptocurrency wallets. Collaborating with teams to deliver high-quality mobile experiences.

🕒 July 24

Bitrefill

11 - 50

💼 Consulting

📦 Logistics

🍽️ Food & Beverage

Lightning Developer working on Bitcoin payment infrastructure for Bitrefill. Collaborating with a global team in a fully remote setting.

🕒 June 27

Castillians

51 - 200

Senior Mobile Engineer designing and developing innovative applications for Play Store and AppStore. Optimizing performance and collaborating globally while enhancing security measures.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok