Research Scientist – Pre-training

🕒 October 14

⏰ Full Time

🟠 Senior

🔴 Lead

🧬 Research Scientist

Where this job comes from

Posted on Pluralis Research's careers page ↗Pluralis Research's careers page, not through a job board

First seen by Remote Rocketship October 14

Still open on Pluralis Research's site. Checked 2 hours ago.

Apply Now
Logo of Pluralis Research

Pluralis Research

1 - 10 employees

🤖 Artificial Intelligence

🌐 Web 3

Artificial Intelligence • Web 3

Pluralis Research is a foundational AI research lab focused on Protocol Learning — decentralized, multi‑participant training of foundation models where no single participant holds a full copy of the model. The group develops methods to enable communication‑efficient model and pipeline parallelism, unextractable collaborative models, and high‑compression context parallelism so community‑trained, community‑owned frontier models can scale over low‑bandwidth, internet‑connected devices. Their work targets practical systems and algorithms that make decentralized training competitive with centralized training while enabling new ownership and economic models.

📋 Description

• Build the training system that takes Protocol Learning from an 8B run to frontier scale • Implement and optimize model-parallel distributed pretraining across heterogeneous GPUs • Implement data, pipeline, and tensor parallelism over low-bandwidth, high-latency links • Reduce communication overhead while maintaining model convergence • Build elasticity and fault tolerance so runs survive node churn • Implement robust checkpointing, state synchronization, and recovery as participants join and leave • Build monitoring to show throughput, bottlenecks, and model quality across hundreds of devices • Train and serve large models on heterogeneous hardware in physically different regions over ordinary internet connections

🎯 Requirements

• Hands-on distributed training required: trained models across many devices in PyTorch using FSDP, DeepSpeed, Megatron, or a custom implementation • Understanding of data, tensor, and pipeline parallelism • Production-quality Python • Concurrency and failure handling experience • Profiling before optimizing • Evidence of execution through shipped systems, research code, open-source work, or serious personal projects • Mission alignment with Protocol Learning • Professional-level English proficiency, written and spoken • Nice to have: experience training or serving large language models such as Nemotron, Qwen, or OLMo • Nice to have: P2P networking and NAT traversal experience • Nice to have: post-training and reinforcement learning experience • Nice to have: inference and serving systems experience • Nice to have: experience at proprietary, open-weight, or open-source AI labs

🏖️ Benefits

• Significant ownership/equity for key technical contributors • High base salary • Flexible work environment • Full visa sponsorship and relocation support to either Australia or the US for exceptional candidates • Opportunity to work on open, unsolved research problems • Remote-first culture • Globally distributed team

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 October 14

Praxis

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Principal Scientist leading analytical development for Praxis, a clinical-stage biopharmaceutical company developing CNS therapies. Managing methods, GMP strategies, and external partners across the product lifecycle.

🕒 October 14

Thomson Reuters

10,000+ employees

💼 Consulting

⚖️ Legal

🛡️ Insurance

Lead Applied Scientist designing production search and retrieval systems for Thomson Reuters legal, tax, and accounting products. Driving ranking, semantic retrieval, evaluation, and AI strategy.

🕒 October 12

Telix Pharmaceuticals Limited

501 - 1000

🏥 Healthcare

💼 Consulting

🧬 Biotechnology

Principal Scientist leading biologics process development and CMC manufacturing activities at Telix Pharmaceuticals. Managing technology development, regulatory content, and external partner collaborations for precision oncology medicines.

🕒 October 11

Kled AI

11 - 50

🤖 Artificial Intelligence

🏪 Marketplace

🤝 B2B

Research Scientist building image, video, and document benchmarks for Kled’s opt-in human data network. Measuring data value for frontier AI models and informing data deals.

🕒 October 9

Praxis

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Principal Scientist leading drug-substance process chemistry for Praxis, a clinical-stage CNS biopharmaceutical company. Driving development, manufacturing strategy, CRO/CDMO execution, and regulatory submissions.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok