Research Engineer – Pretraining Data

πŸ•’ October 16

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $150k - $350k / year

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ“š Research Engineer

Where this job comes from

Posted on Prime Intellect's careers page β†—Prime Intellect's careers page, not through a job board

First seen by Remote Rocketship October 16

Still open on Prime Intellect's site. Checked 1 hour ago.

Apply Now
Logo of Prime Intellect

Prime Intellect

1 - 10 employees

πŸ€– Artificial Intelligence

☁️ SaaS

Artificial Intelligence β€’ SaaS β€’ Cloud Computing

Prime Intellect is a company focused on democratizing AI development by providing scalable and decentralized computing resources for training models. Their platform allows users to find and share global compute resources, enabling the training of state-of-the-art models through distributed clusters. They promote the collective ownership of AI innovations, including language and scientific models. Prime Intellect also offers a range of GPU options to facilitate affordable and efficient model training. They aim to advance decentralized training research and open-source AI development on a global scale.

πŸ“‹ Description

β€’ Find, evaluate, and collect valuable training data from web, code, and technical sources β€’ Build scalable pipelines that turn raw data into training-ready corpora through extraction, cleaning, deduplication, and filtering β€’ Develop checks for data quality, coverage, and contamination, and use them to improve collection and processing β€’ Work with researchers on data mixtures and sampling strategies for pretraining and midtraining β€’ Prepare and evaluate data for long-context learning, reasoning, and coding, testing synthetic data where useful β€’ Run controlled data experiments and use model evaluations to decide which sources, mixtures, and processing choices are worth scaling β€’ Make large-scale data processing efficient, reproducible, and recoverable, with clear source provenance and dataset versioning

🎯 Requirements

β€’ Strong programming skills in Python and a record of building reliable data-processing or distributed systems β€’ Experience working with large datasets and managing the practical tradeoffs of storage, compute, throughput, and reproducibility β€’ Ability to diagnose data-quality issues and translate research goals into measurable checks and experiments β€’ Comfort owning an evolving technical problem end to end and working closely with researchers to test assumptions and improve the system β€’ Experience with web crawling, document extraction, code-data collection, or large-scale corpus curation β€’ Experience with deduplication, text classification, quality scoring, synthetic data, or training-data contamination analysis β€’ Experience with data-mixture experiments, curriculum learning, or measuring how dataset changes affect model performance β€’ Experience preparing datasets for language-model pretraining, continued pretraining, or midtraining is nice to have β€’ Work with distributed processing frameworks such as Spark, Ray, or comparable systems is nice to have β€’ Experience with multilingual, mathematical, scientific, or repository-level code data is nice to have β€’ Familiarity with tokenization, training data loaders, and the needs of large model-training runs is nice to have

πŸ–οΈ Benefits

β€’ Equity incentives β€’ Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco β€’ Visa sponsorship β€’ Relocation assistance for international candidates β€’ Quarterly team off-sites β€’ Hackathons β€’ Conferences and learning opportunities

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ October 9

Sequen

11 - 50

☁️ SaaS

πŸ€– Artificial Intelligence

🀝 B2B

Staff Research Engineer owning Sequen’s Python runtime for autonomous AI research agents. Building resilient infrastructure, evaluation systems, and observability for production ranking intelligence.

πŸ•’ October 9

Sequen

11 - 50

☁️ SaaS

πŸ€– Artificial Intelligence

🀝 B2B

Staff+ Research Engineer advancing Sequen’s autonomous ranking intelligence engine through recursive self-improvement. Setting research direction, running experiments, and shipping production improvements for major retailers and platforms.

πŸ•’ October 8

Burq

11 - 50

🍽️ Food & Beverage

πŸ₯ Healthcare

πŸ—οΈ Construction

Staff ML/OR engineer building ML-assisted dispatch, pricing, forecasting, and routing systems for Burq's logistics platform. Owning optimization architecture and production models with company-level impact.

πŸ•’ October 1

Mortenson

5001 - 10000

πŸ₯ Healthcare

🏨 Hospitality

πŸ—οΈ Construction

Innovation Engineer evaluating technologies, developing prototypes, and scaling solutions for Mortenson, a builder, developer, and EPC company. Improving construction processes through research, testing, and commercialization.

πŸ•’ September 29

Higharc

11 - 50

πŸ—οΈ Construction

πŸ’Ό Consulting

🏠 Real Estate

Applied Research Engineer shipping spatial AI models into Higharc’s home-design and construction platform. Building APIs, evaluation pipelines, and production ML capabilities.

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok