
1 - 10 employees
Founded 2023
π€ Artificial Intelligence
βοΈ SaaS
π API
Artificial Intelligence β’ SaaS β’ API
Featherless AI is a serverless AI inference and model hosting provider that offers API access to a large and growing catalog of open-weight models (12,200+), enabling developers and businesses to deploy, fine-tune, and run models at scale without managing servers. The company provides flat subscription pricing with unlimited tokens, GPU orchestration, private/anonymous usage (no logs), and options for enterprise self-hosting or scale units for high concurrency. Featherless AI also operates as an AI research lab focused on open-source and post-transformer model research, claiming significant cost and performance improvements for large models and AI agents.
Likely ghost job
π January 22
π Anywhere in the World
π΅ Estimated: $258,000 - $329,000 / year
β° Full Time
π Senior
π€ Machine Learning Engineer
π» Ghost score 65%
Where this job comes from
Posted on Featherless AI's careers page β, not through a job board
First seen by Remote Rocketship January 22
Still open on Featherless AI's site. Checked 53 minutes ago.

1 - 10 employees
Founded 2023
π€ Artificial Intelligence
βοΈ SaaS
π API
Artificial Intelligence β’ SaaS β’ API
Featherless AI is a serverless AI inference and model hosting provider that offers API access to a large and growing catalog of open-weight models (12,200+), enabling developers and businesses to deploy, fine-tune, and run models at scale without managing servers. The company provides flat subscription pricing with unlimited tokens, GPU orchestration, private/anonymous usage (no logs), and options for enterprise self-hosting or scale units for high concurrency. Featherless AI also operates as an AI research lab focused on open-source and post-transformer model research, claiming significant cost and performance improvements for large models and AI agents.
β’ Optimize inference latency, throughput, and cost for large-scale ML models in production β’ Profile and bottleneck GPU/CPU inference pipelines (memory, kernels, batching, IO) β’ Implement and tune techniques such as: β’ Quantization (fp16, bf16, int8, fp8) β’ KV-cache optimization & reuse β’ Speculative decoding, batching, and streaming β’ Model pruning or architectural simplifications for inference β’ Collaborate with research engineers to productionize new model architectures β’ Build and maintain inference-serving systems (e.g. Triton, custom runtimes, or bespoke stacks) β’ Benchmark performance across hardware (NVIDIA / AMD GPUs, CPUs) and cloud setups β’ Improve system reliability, observability, and cost efficiency under real workloads
β’ Strong experience in ML inference optimization or high-performance ML systems β’ Solid understanding of deep learning internals (attention, memory layout, compute graphs) β’ Hands-on experience with PyTorch (or similar) and model deployment β’ Familiarity with GPU performance tuning (CUDA, ROCm, Triton, or kernel-level optimizations) β’ Experience scaling inference for real users (not just research benchmarks) β’ Comfortable working in fast-moving startup environments with ownership and ambiguity β’ Experience with LLM or long-context model inference β’ Knowledge of inference frameworks (TensorRT, ONNX Runtime, vLLM, Triton) β’ Experience optimizing across different hardware vendors β’ Open-source contributions in ML systems or inference tooling β’ Background in distributed systems or low-latency services
β’ Competitive compensation + meaningful equity at Series A
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.