Freelance Pre-Training Engineer

Job not on LinkedIn

November 7

Apply Now

Receive Emails with Similar Jobs

KOG

WebsiteLinkedInAll Job Openings

Kamal Osman Group is founded in 1994 is an Egyptian group that includes a diverse group of leading companies in multiple sectors. Over more than 30 years the group has been grown under Kamal Osman leadership, evolving into a renowned brand built on efficiency and innovation. In 2022, the group’s annual revenue exceeded one billion Egyptian pounds, which is evidence of its success and sustainable presence in the market.

51 - 200 employees

Founded 1994

📋 Description

• Profile current LLM pretraining runs on an NVIDIA H100 cluster using NCCL and SLURM. • Critique and improve launch, scheduling, data and model parallelism, checkpointing, fault tolerance, and monitoring practices. • Implement targeted fixes to improve stability, throughput, and cost efficiency on 200+ GPU jobs. • Produce clear documentation and runbooks enabling the team to sustain improvements. • Bonus: bring practical LLM expertise that improves pretraining efficiency or quality through better model or training architecture choices.

🎯 Requirements

• Recent hands-on experience training neural networks on NVIDIA clusters with H100 GPUs and NCCL. • Deep knowledge of SLURM for large multi-node jobs at scale. • Strong expertise in end-to-end profiling of training workloads and removing bottlenecks. • Proven track record with LLM pre-training on large clusters of several hundred GPUs. • Pragmatic engineering mindset focused on launching, optimizing, and monitoring real training. • Not a research role. We value practical, production-grade execution over theory. • You have done this elsewhere and can step in immediately.

🏖️ Benefits

• Freelance engagement from 1 day up to 2 weeks. • Remote-friendly. • Attractive day rate. • Strong performance can lead to a full-time offer.