Research Scientist – Pre-training

🔥 16 hours ago

🌐 United States, Australia – Remote

🇺🇸 United States – Remote 🇦🇺 Australia – Remote

🏄 California – Remote

🏄 California – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧬 Research Scientist

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Pluralis Research

WebsiteLinkedInAll Job Openings

1 - 10 employees

🤖 Artificial Intelligence

🌐 Web 3

Artificial Intelligence • Web 3

Pluralis Research is a foundational AI research lab focused on Protocol Learning — decentralized, multi‑participant training of foundation models where no single participant holds a full copy of the model. The group develops methods to enable communication‑efficient model and pipeline parallelism, unextractable collaborative models, and high‑compression context parallelism so community‑trained, community‑owned frontier models can scale over low‑bandwidth, internet‑connected devices. Their work targets practical systems and algorithms that make decentralized training competitive with centralized training while enabling new ownership and economic models.

📋 Description

• Build the training system that takes Protocol Learning from the 8B run to frontier scale • Implement and optimize model-parallel training across heterogeneous GPUs and low-bandwidth, high-latency links • Implement communication-reduction techniques while maintaining model convergence • Make training runs survive node churn through robust checkpointing, state synchronization, and recovery • Build monitoring to show throughput, bottlenecks, and model quality across hundreds of devices

🎯 Requirements

• Hands-on distributed training is required: trained models across many devices in PyTorch with FSDP, DeepSpeed, Megatron, or an own implementation • Understanding of data, tensor, and pipeline parallelism • Production-quality Python • Experience with concurrency, failure handling, and profiling before optimizing • Evidence of shipped systems, research code, open-source work, or serious personal projects • Belief in Protocol Learning as a viable third path for collective, trustless, and sovereign AI • Professional-level English proficiency, written and spoken • Nice to have: experience training or serving large language models such as Nemotron, Qwen, or OLMo • Nice to have: experience with P2P networking and NAT traversal • Nice to have: experience with post-training and RL • Nice to have: experience with inference and serving systems • Nice to have: experience at proprietary, open-weight, and open-source AI labs • Comfortable working across timezones

🏖️ Benefits

• Significant equity ownership in addition to a high base salary • Flexible remote work environment • Optional full visa sponsorship and relocation support to Australia or the US