Member of Technical Staff, Training Engineer – Large Scale Foundation Models

Job not on LinkedIn

October 11

Apply Now

Receive Emails with Similar Jobs

FirstPrinciples Holding Company

WebsiteLinkedInAll Job Openings

B2B • Enterprise • Finance

FirstPrinciples Holding Company focuses on building and scaling a portfolio of successful commercial businesses. The company leverages strategic insight and operational expertise to maximize value and growth within its portfolio companies. FirstPrinciples aims to provide sustainable solutions that drive long-term success for its partners and stakeholders.

51 - 200 employees

🤝 B2B

🏢 Enterprise

💸 Finance

📋 Description

• Develop and lead end-to-end pre-training of large language models on GPU clusters. • Combine deep engineering expertise with research intuition. • Build data pipelines and perform distributed training at scale. • Make informed decisions about microbatch and global batch configurations. • Provide strategic insights to the executive team on financial implications. • Design capital allocation frameworks for sustainability. • Operate distributed training infrastructure using modern techniques. • Write production-grade PyTorch and Triton/CUDA kernels when required. • Lead cross-functional efforts and mentor engineers.

🎯 Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or related field. • 7-12+ years of total experience, including 2+ years training large Transformers at scale. • Hands-on experience with at least one frontier-style training run. • Expert-level proficiency in PyTorch (including compiled mode/torch.compile). • Deep facility with distributed frameworks (PyTorch FSDP or DeepSpeed ZeRO). • Proven success operating multi-node GPU jobs. • Demonstrated impact from data quality work. • Strong applied mathematics background.

🏖️ Benefits

• Health insurance • Innovative research environment • Collaboration with top experts • Opportunity to work on groundbreaking technology • Flexible remote work