Machine Learning Engineer – Training Optimization

Likely ghost job

πŸ•’ January 22

🌏 Anywhere in the World

⏰ Full Time

🟠 Senior

πŸ€– Machine Learning Engineer

Where this job comes from

Posted on Featherless AI's careers page β†—Featherless AI's careers page, not through a job board

First seen by Remote Rocketship January 22

Still open on Featherless AI's site. Checked 1 hour ago.

Apply Now
Logo of Featherless AI

Featherless AI

1 - 10 employees

Founded 2023

πŸ€– Artificial Intelligence

☁️ SaaS

πŸ”Œ API

Artificial Intelligence β€’ SaaS β€’ API

Featherless AI is a serverless AI inference and model hosting provider that offers API access to a large and growing catalog of open-weight models (12,200+), enabling developers and businesses to deploy, fine-tune, and run models at scale without managing servers. The company provides flat subscription pricing with unlimited tokens, GPU orchestration, private/anonymous usage (no logs), and options for enterprise self-hosting or scale units for high concurrency. Featherless AI also operates as an AI research lab focused on open-source and post-transformer model research, claiming significant cost and performance improvements for large models and AI agents.

πŸ“‹ Description

β€’ Optimize large-scale model training pipelines (throughput, convergence, stability, and cost) β€’ Improve distributed training strategies (data, model, and pipeline parallelism) β€’ Tune optimizers, schedulers, batch sizing, and precision (bf16 / fp16 / fp8) β€’ Reduce training time and compute cost via profiling, bottleneck analysis, and systems-level improvements β€’ Collaborate with researchers on architecture-aware training strategies β€’ Build and maintain robust training infrastructure (checkpointing, fault tolerance, reproducibility) β€’ Evaluate and integrate new training techniques (e.g. gradient checkpointing, ZeRO, FSDP, custom kernels) β€’ Own training performance metrics and continuously push them forward

🎯 Requirements

β€’ Strong experience training large neural networks (LLMs or similarly large models) β€’ Hands-on experience with training optimization (not just model usage) β€’ Solid understanding of: β€’ - Backpropagation, optimization algorithms, and training dynamics β€’ - Distributed systems for ML training β€’ Experience with PyTorch (required) β€’ Comfort working close to hardware (GPUs, memory, networking constraints) β€’ Ability to move fluidly between research ideas and production-ready code β€’ Nice to Have β€’ Experience with large-scale distributed training (multi-node, multi-GPU) β€’ Familiarity with DeepSpeed, FSDP, Megatron, or custom training stacks β€’ Experience optimizing training on AMD or NVIDIA GPUs β€’ Contributions to open-source ML infrastructure or research codebases β€’ Exposure to non-Transformer architectures (RNNs, hybrid models, etc.)

πŸ–οΈ Benefits

β€’ Competitive compensation + meaningful equity

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok