Machine Learning Engineer – Inference Optimization

Likely ghost job

πŸ•’ January 22

🌏 Anywhere in the World

⏰ Full Time

🟠 Senior

πŸ€– Machine Learning Engineer

Where this job comes from

Posted on Featherless AI's careers page β†—Featherless AI's careers page, not through a job board

First seen by Remote Rocketship January 22

Still open on Featherless AI's site. Checked 53 minutes ago.

Apply Now
Logo of Featherless AI

Featherless AI

1 - 10 employees

Founded 2023

πŸ€– Artificial Intelligence

☁️ SaaS

πŸ”Œ API

Artificial Intelligence β€’ SaaS β€’ API

Featherless AI is a serverless AI inference and model hosting provider that offers API access to a large and growing catalog of open-weight models (12,200+), enabling developers and businesses to deploy, fine-tune, and run models at scale without managing servers. The company provides flat subscription pricing with unlimited tokens, GPU orchestration, private/anonymous usage (no logs), and options for enterprise self-hosting or scale units for high concurrency. Featherless AI also operates as an AI research lab focused on open-source and post-transformer model research, claiming significant cost and performance improvements for large models and AI agents.

πŸ“‹ Description

β€’ Optimize inference latency, throughput, and cost for large-scale ML models in production β€’ Profile and bottleneck GPU/CPU inference pipelines (memory, kernels, batching, IO) β€’ Implement and tune techniques such as: β€’ Quantization (fp16, bf16, int8, fp8) β€’ KV-cache optimization & reuse β€’ Speculative decoding, batching, and streaming β€’ Model pruning or architectural simplifications for inference β€’ Collaborate with research engineers to productionize new model architectures β€’ Build and maintain inference-serving systems (e.g. Triton, custom runtimes, or bespoke stacks) β€’ Benchmark performance across hardware (NVIDIA / AMD GPUs, CPUs) and cloud setups β€’ Improve system reliability, observability, and cost efficiency under real workloads

🎯 Requirements

β€’ Strong experience in ML inference optimization or high-performance ML systems β€’ Solid understanding of deep learning internals (attention, memory layout, compute graphs) β€’ Hands-on experience with PyTorch (or similar) and model deployment β€’ Familiarity with GPU performance tuning (CUDA, ROCm, Triton, or kernel-level optimizations) β€’ Experience scaling inference for real users (not just research benchmarks) β€’ Comfortable working in fast-moving startup environments with ownership and ambiguity β€’ Experience with LLM or long-context model inference β€’ Knowledge of inference frameworks (TensorRT, ONNX Runtime, vLLM, Triton) β€’ Experience optimizing across different hardware vendors β€’ Open-source contributions in ML systems or inference tooling β€’ Background in distributed systems or low-latency services

πŸ–οΈ Benefits

β€’ Competitive compensation + meaningful equity at Series A

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok