Principal ML Solutions Architect – Token Factory

Job not on LinkedIn

🔥 15 hours ago

🇺🇸 United States – Remote

💵 $208k - $261k / year

⏰ Full Time

🔴 Lead

💻 Solutions Engineer

👻 Ghost score 21%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Nebius Group

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

Artificial Intelligence • Enterprise • SaaS

Nebius Group is building one of the world’s leading AI infrastructure companies, focusing on providing the necessary compute, storage, and tools for developers in the AI space. Based in Europe and listed on Nasdaq, Nebius has a global presence with R&D centers across Europe, North America, and Israel. The company's primary offering is an AI-centric cloud platform designed for intensive AI workloads, complemented by various other businesses involved in generative AI development, edtech, and autonomous technology.

📋 Description

• Own the most complex, highest-stakes customer engagements from architecture through production across multiple modalities, driving measurable business value • Optimize LLM inference at framework and hardware level and codify best practices into reusable team playbooks • Lead supervised and reinforcement fine-tuning efforts to maximize model quality • Design and implement production-ready LLM solutions using Token Factory inference services • Provide technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade-offs at scale • Partner with product, engineering, and research teams to surface customer needs, prototype platform features, and influence the roadmap • Guide customers from proof of concept to production, focusing on performance, reliability, and cost efficiency • Define standards for customer delivery and technical execution • Mentor Senior and mid-level Solutions Architects through review, enablement, and knowledge sharing • Represent Token Factory externally through talks, blog posts, and conferences

🎯 Requirements

• 8+ years of experience in ML/AI systems, including at least 4 years focused on LLMs and generative AI • Demonstrated technical leadership, owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers • Expert knowledge of the LLM ecosystem, including model architectures, fine-tuning approaches, and inference internals • Deep, hands-on command of inference optimization, including quantization, KV-cache management, batching, and routing • Experience running LLMs in production at scale, deploying, operating, and debugging inference workloads down to the framework level • Experience with LLM fine-tuning, including SFT/LoRA, data preparation/curation, and RL-based fine-tuning • Experience building task-specific LLM benchmarks and offline/online evaluation pipelines, including LLM-as-a-judge setups • Experience with inference frameworks and libraries such as vLLM, SGLang, and TensorRT-LLM, including reading, modifying, and contributing to their internals • Experience deploying LLM-powered applications using OpenAI, Anthropic, or open-source model APIs • Strong Python programming skills • Excellent communication skills, with ability to explain technical concepts to engineers and executives • Applicants must be authorized to work in the country in which they apply and provide proof of employment eligibility • Added bonus: contributions or maintainership in major OSS inference/ML projects • Added bonus: published research, conference talks, or widely-read technical writing in the LLM/serving space • Added bonus: deep work with multimodal AI models • Added bonus: proficiency with Docker, Kubernetes, and infrastructure-as-code • Added bonus: experience building or owning internal ML workflow tooling/automation at scale • Preferred technical stack includes Python; vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs; Kubernetes, Docker, Git; AWS, GCP, and Azure ML platforms

🏖️ Benefits

• 100% company-paid medical, dental, and vision coverage for employees and families • 401(k) plan with up to 4% company match and immediate vesting • 20 weeks paid parental leave for primary caregivers and 12 weeks for secondary caregivers • Up to $85/month remote work reimbursement for mobile and internet • Company-paid short-term, long-term, and life insurance coverage • Competitive compensation • Career growth and learning opportunities • Flexibility and ownership • Collaborative and innovative culture • Opportunity to work on impactful AI projects • International environment and talented teams

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume