Research Engineer – Pretraining

πŸ•’ October 16

Where this job comes from

Posted on Prime Intellect's careers page β†—Prime Intellect's careers page, not through a job board

First seen by Remote Rocketship October 16

Still open on Prime Intellect's site. Checked 1 hour ago.

Apply Now
Logo of Prime Intellect

Prime Intellect

1 - 10 employees

πŸ€– Artificial Intelligence

☁️ SaaS

Artificial Intelligence β€’ SaaS β€’ Cloud Computing

Prime Intellect is a company focused on democratizing AI development by providing scalable and decentralized computing resources for training models. Their platform allows users to find and share global compute resources, enabling the training of state-of-the-art models through distributed clusters. They promote the collective ownership of AI innovations, including language and scientific models. Prime Intellect also offers a range of GPU options to facilitate affordable and efficient model training. They aim to advance decentralized training research and open-source AI development on a global scale.

πŸ“‹ Description

β€’ Build and extend the pretraining code in prime-rl, taking small experiments into full training runs β€’ Evaluate model architecture changes, including MoE and attention designs, against model quality and training cost β€’ Profile training jobs and improve end-to-end throughput with systems engineers on hardware-aware execution β€’ Make long runs resilient to failures through reliable checkpointing and recovery β€’ Investigate training dynamics and numerical stability, ensuring optimizations preserve convergence β€’ Run controlled ablations to guide larger experiments while keeping setup and results reproducible β€’ Work with data and evaluation researchers on training mixtures, including midtraining and long-context experiments β€’ Take the next open models from architecture experiments through full pretraining runs, scaling toward 1–3T parameters

🎯 Requirements

β€’ Hands-on experience training language models, including modifying training code and following the effects through actual runs β€’ Strong Python skills β€’ Experience with PyTorch or a comparable framework β€’ Systems understanding sufficient to debug distributed training β€’ Practical understanding of model architectures and optimization, including their effect on convergence β€’ Ability to design ablations that answer research questions and explain what results do and do not show β€’ Good judgment about what to investigate independently and when to involve a colleague

πŸ–οΈ Benefits

β€’ Equity incentives included in cash compensation range β€’ Flexible work arrangements, with the option to work remotely or in-person at offices in San Francisco β€’ Visa sponsorship β€’ Relocation assistance for international candidates β€’ Quarterly team off-sites β€’ Hackathons β€’ Conferences and learning opportunities β€’ Opportunity to work with a talented, hard-working and mission-driven team

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 9

Sequen

11 - 50

☁️ SaaS

πŸ€– Artificial Intelligence

🀝 B2B

Staff Research Engineer owning Sequen’s Python runtime for autonomous AI research agents. Building resilient infrastructure, evaluation systems, and observability for production ranking intelligence.

πŸ•’ October 9

Sequen

11 - 50

☁️ SaaS

πŸ€– Artificial Intelligence

🀝 B2B

Staff+ Research Engineer advancing Sequen’s autonomous ranking intelligence engine through recursive self-improvement. Setting research direction, running experiments, and shipping production improvements for major retailers and platforms.

πŸ•’ October 8

Burq

11 - 50

🍽️ Food & Beverage

πŸ₯ Healthcare

πŸ—οΈ Construction

Staff ML/OR engineer building ML-assisted dispatch, pricing, forecasting, and routing systems for Burq's logistics platform. Owning optimization architecture and production models with company-level impact.

πŸ•’ September 29

Higharc

11 - 50

πŸ—οΈ Construction

πŸ’Ό Consulting

🏠 Real Estate

Applied Research Engineer shipping spatial AI models into Higharc’s home-design and construction platform. Building APIs, evaluation pipelines, and production ML capabilities.

πŸ•’ September 25

829 Studios

201 - 500

πŸ“£ Marketing

🀝 B2B

πŸ€– Artificial Intelligence

AI Innovation Engineer building Python agentic workflows, MCP integrations, and AI tools for 829 Studios, a Boston-based digital marketing agency. Driving adoption across marketing operations.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $110k - $135k / year

πŸ’° Series unknown on 2021-09

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ“š Research Engineer

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok