Machine Learning Engineer – Distillation

Likely ghost job

🕒 January 22

🌏 Anywhere in the World

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 Machine Learning Engineer

Where this job comes from

Posted on Featherless AI's careers page ↗Featherless AI's careers page, not through a job board

First seen by Remote Rocketship January 22

Still open on Featherless AI's site. Checked 10 hours ago.

Apply Now
Logo of Featherless AI

Featherless AI

1 - 10 employees

Founded 2023

🤖 Artificial Intelligence

☁️ SaaS

🔌 API

Artificial Intelligence • SaaS • API

Featherless AI is a serverless AI inference and model hosting provider that offers API access to a large and growing catalog of open-weight models (12,200+), enabling developers and businesses to deploy, fine-tune, and run models at scale without managing servers. The company provides flat subscription pricing with unlimited tokens, GPU orchestration, private/anonymous usage (no logs), and options for enterprise self-hosting or scale units for high concurrency. Featherless AI also operates as an AI research lab focused on open-source and post-transformer model research, claiming significant cost and performance improvements for large models and AI agents.

📋 Description

• Design and implement knowledge distillation pipelines (teacher–student, self-distillation, multi-teacher, etc.) • Distill large foundation models into smaller, faster, and cheaper models for inference • Run and analyze large-scale training experiments to evaluate quality, latency, and cost tradeoffs • Collaborate with research to translate new distillation ideas into production-ready code • Optimize training and inference performance (memory, throughput, latency) • Contribute to internal tooling, evaluation frameworks, and experiment tracking • (Optional) Contribute back to open-source models, tooling, or research

🎯 Requirements

• Strong background in machine learning or deep learning • Hands-on experience with model distillation (LLMs or other neural networks) • Solid understanding of training dynamics, loss functions, and optimization • Experience with PyTorch (or JAX) and modern ML tooling • Comfort running experiments on multi-GPU or distributed setups • Ability to reason about model quality vs. performance tradeoffs • Pragmatic mindset: you care about shipping, not just papers

🏖️ Benefits

• Competitive compensation • Meaningful equity • Remote-friendly, async-first environment

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok